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The foHowig prinaples guicte our research related to the educatKDn arxl employment of youth and 
adults with specialized educatKXi, training, employment, and adjustment needs 



• Individuals have a basic right to be educated and 
to work in the environment that least restricts their 
right to leam and interact wrth other students and 
persons who are not handicapped. 

• Individuals with varied abilities, social 
backgrounds, aptitudes, and learning styles must 
have equal access and opportunity to engage in 
education and work, and life-k>ng learning. 

• EducatKXiai experiences must be planned, 
delivered, and evaluated based upon the unique 
abilities, social backgrounds, and learning styles of 
the indivkjual. 

• Agencies, organl::ations, and individuals from a 
broad array of disciplines and professional fields 
must effectively and systematically coordinate their 
efforts to meet indivkjual education and 
employment needs 



• Individuals grow and mature throughout their lives 
requinng varying levels and types of educational 
and employment support 

• The capability of an individual to obtain and hold 
meaningful and productive employment is 
important to the individual's quality of life 

• Parents, advocates, and friends form a vitally 
important social network that is an instrumental 
aspect of education, transition to employment, and 
continuing employment 
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During the past few years there has been a proliferation of 
prograrus to provide supported employment for persons with 
disabilities • These employment options grew out of the earlier 
competitive employment efforts and mcJel demonstration projects 
established to ensure 1 ng-term employment for persons with 
disabilities* The additional influx of both federal and state 
funds designated to increase supported employment efforts 
beyond those demonstration projects has meant the added 
responsibility of accountability not only for the outcomes of 
new efforts^ but for the process of providing quality services 
to persons with disabilities. This new responsibility has led 
to the development of data collection systems to monitor the 
outcomes of supported employment as well as of innovative 
methods of analyzing the process of providing supported 
employment services to persons with disabilities. Evaluating 
the process as well as the outcome enables us to study the 
relationship between the two entities as a gauge of progran 
effectiveness. 

This issue of Supported Employment in Illinois includes 
reports of three research studies concerning the process of 
providing supported employment services to persons with 
disabilities. These articles describe the design of an 
instrument to measure the process of supported employment, 
present a validation of that instrument, and discuss the use of 
case study methodology as a means of studying the process of 
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supported-employment services aelivery. 

In Supported Eniployment Proqtain Development Degree of 
Implementation Manual , Trach, Rusch, and DeStefano present an 
evaluation instrument that utilizes a research-based model of 
supported employment to assess programmatic efforts. This 
version of the instrument incorporates the results of two years 
of field-testing and feedback with supported employment 
programs in Illinois, The result is a revised edition that not 
only addresses the provision of services to persons with 
varying levels of disability, but also accommodates the 
different models for providing supported employment, 
individual, enclave, and mobile-work-crew placement. The model 
includes 26 activities organized into five components to define 
supported employment for persons with disabilities. The 
components include: (a) surveying che community, (b) matching 
target employees to potential placements, (c) providing initial 
training, (d) developing long-term follow-up, and (e) 
coordinating services across agencies. The instrument is 
scored through the review of written documentation. The Manual 
provides many examples of activity-related documentation and 
includes references to relevant literature. Also included are 
a scoring protocol and definitions of level of implementation 
for each activity. The Manual and definitions provide the 
template for an effective supported employment program. 

Trach and Rusch provide additional information about the 
evaluation instrument in Validation of an Instrument for 
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Evaluating Supported Employment Programs; The Degree of 
Implementation > This study proposes a supported employmexnc 
model and an instrument, the Degree of Implementation , to 
measure the degree to which programs implement this mcdel. In 
addition this study examines the relationship between degree of 
implementation and various program outcomes. Supported 
employment programs developed by 3 3 adult vocational servico 
agencies in Illinois served as the subject pool for data 
collection. Correlational analyses provided evidence of 
construct validity. In addition, an inverse relationship was 
found between IQ and hourly wage, and a direct relationship was 
found between job-matching activities and the number of 
hours speiit in job development. This study proviaed noL only a 
validation for the evaluation efforts in the Illinois 
initative, but also a direction for other evaluation efforts of 
supported employment across the nation. 

Winking and DeStefano present a qualitative approach to 
process evaluation in Case Study Analysis of Three Supported 
Employment ^iOdel Programs: The Community, the Agency, and the 
Program . This study analyzes programmatic issues in supported 
employment through case studies of urban, rural, and suburban 
programs associited with the Illinios Supported Employment 
Initiative. The choice of programs for study was based on four 
criteria: (a) the development of multiple placement sites or 
enclaves, (b) the placement of the number of workers specified 
in their respective grants, (c) the provision of services to 
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individuals with severe disabilities, and (d) the attainnient of 
scores in the upper guar tile and within 5 points of one another 
on a Degree of Implementation measure. Winking and DeStefano 
discuss the community-based nature of supported employment 
programs and their obli^-^tion to meet the needs of a variety of 
consumers, groups, including parents, employers, workers with 
disabilities, and the community at large. The case studies 
focus on the multiple perspectives of these and r>*:her key 
stakeholders involved in the supported employment process 
(i.e., program staff, co-workers and other agency personnel). 
Individual program dynamics were analyzed to determine specific 
factors that might contribute to programmatic success in 
implementing supported employment. Thus, the analysis serves 
as an aid to agencies interested in replicating supported 
employment and highlights implications at the program, agency, 
and community levels. 

We hope that this volume will provide insight into an 
evaluation method that utilizes a process-oriented perspective 
to determine the effectiveness of programming for supported 
employruent. We v:elcome your couu^ents and suggestions and hope 
that you find the document useful and informative. 

John S. Trach 
Frank R. Rusch 
July 1987 

Champaign , I 1 linois 
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Introduction to Supported Employment in Illinois: 
Current Status, of the Initiative 

Frank R, Rusch, John S, Trach, 
Debbie Winking, Jeffrey J, Tines, and Richard P. Zchutz 



Two very important ways in which America measures its 
progress and achievements are in terms of the education and 
employment of its citizens. However, until 1975 one group of 
American citizens was frequently denied public education. With 
the passing of the Education for All Handicapped Children Act in 
1975, education was mandated for every disabled person of school 
a^^e, and people with disabilities are now enjoying the benefits 
of a public education. Unfortunately, employment opportunities 
continue to be severely limited fc^r this group, and people with 
disabilities who are graduating from school may be the most 
unemployed, underemployed, and lowest paid of all American 
citizens. The facts are: 

Approximately 70% of all disabled AmericarxS 

between the ages of 16 and 64 are unemployed. 

Only 25% of employed disabled Americans are 

employed full-time. 

The majority of these Americans are employed 
part-time. 
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It is clear that strong measures are needed by both the 
government and the private sector to educate people who are not 
disabled so that they can erlucate and rehabilitate people with 
disabilities to prepare Lhem to be employed successfully in the 
community. 

Be ause of recent, important changes in both education and 
rehabilitation legislation, the impetus exists to better educate 
consumers and educators alike. The focus of this report is upon 
changes in rehabilitation legislation and supported employment; 
specifically, the following report introduces supported 
employment in Illinois. 

Overview of Changes in Rehabilitation Legislation 

Because of recent changes in the Rehabilitation Act of 1973, 
supported employment is a new option available to all persons 
wit I disabilities. The Rehabilitation Act of 1973 was 
reauthorized for five years (Public Law 99-506) with special 
attention to supported employment as an option for direct 
services and project funding. Key changes included: 

1. Title I (Basic State Agency Funding) addition of supported 
employment as an authorized vocational rehabilitation service and 
outcome, 

2. Title III (Discretionary Grants) revision to include 
supported employrnent (and transitional services) as eligible 
funding activities. 
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3. Title ^^I (Employment Opportunities) expansion, adding 
Section C supporte ici.r.ent as a state formula-grant 
rehabilitation services program, supplementing the Title I 
allocation, and 

4. changes in the definition of "severe handicap" to provide 
a more function-oriented definition that is somewhat compatible 
with the definition of developniental disability contained in the 
Developmental Disabilities Act (Public Law 98-527), although it 
is intended for a broader group with severe disabilities 
(including persons ^^ith severe physical disabilities) 
(Rehabilitation Act "Amendments, 1986). 

What Is Supported Eir.ployment ? 

Placement of persons with disabilities into integrated 
settings has evolved from research and demonstration activities 
during the past 15 years. Supported employment is one means of 
achieving integration whereby the worker receives continuing 
support for the duration of his or her employment. There are 
presently three models of supported employment: (a) individual 
placements, (l) enclav^js, and (c) mobile work crews. In each 
case the support provided at the employment site is ongoing and 
is not expected to stop. The latter two models, however, rely 
upon more intense levels of continuing support. In some ^ isos, 
the support is constant and continues for the duration of the 
employment period. Table 1 presents some c the distinguishing 
characteristics of the thre^ supported employment models. 

-E^ J 3 
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There are two tasic types of supported employment placements 
individual placements and group placements. Individual 
placements usually involve the training and employment of one 
person with a disability with the goal of eventually withdrawing 
daily supervision and training by, for example, a job coach. 
Group placement models such as the mooile work crew and enclave 
models typically involve ongoing supervision and training. Every 
model requires th*^ employment of disabled employees in jobs where 
they will be working with employees who are not disabled and 
earning comparable wages for performing the same or similiar work 
or wages based on employee productivity compared to an 
established norm. 

Although Table 1 describes the characteristics of three 
different supported employment models, it should be clear that 
employment in local community settings, integrat'on with 
nondisabled workers, ongoing support, and fair wages are common 
elements of these and any supported employment model. It is 
natural to expect variations of these models to accommodate 
individual and employer needs and the employment situation of the 
local community. Variations of these models are only limited by 
the degree of ingenuity and flexibility of rehabilitation 
personnel developing supported employment services. 

As a direct result of emerging supported employment models in 
Illinois, integrated employment opportunities for individuals 
with disabilities are gradually improving. Currently, supported 
employees in Illincis are earning an average salary of $3.21 per 
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Table 1 

suFmmi. BHPiimgig hookls pi nmpis 



IWlViUUAL FIA3ME1IT 



NQBIU WRK CRBH 



HIOAVE 



Description 



A single individual is hired by 
an employer in the comounity to 
perform a job. 



A SBiall groiip of three to five persons 
to work out of a van at several loca- 
tions in the comnunity with the super- 
vision of a job coach. 



A group of six to eight persons 
who work as a team at a specific 
location in a comnunity business 
or industry. 



of 



Support 



Job coach train^ and assists 
the employee arid gradually 
decreases 'the amount of support. 



Continuous training and supervision 
provided by the job coach. 



Continuous training and supervision 
provided by the job coach v^o may 
be employed by the company. 



Typical 
Jobs 



Food s**rvice, janito«.ial, 
assembly y hotel /motel house- 
keeping positions. 



Grounds iiaintenance, custodial work 
janitorial, housekeeping, or catering 
work. 



Light manufacturing, electronics 
subassembly, warehouse packing, 
industry work. 



Nontal or 

Fttysical 
Liaitations 



Persons should exhibit 
appropriate social skills and 
autonomy and eventually require 
minimal or no supervision and 
training. 



Continuous supervision and training 
provided by this model will accommodate 
the needs of employees with severe 
handicaps and behavior problems. 



Individtjals with severe handicaps, 
behavior problems, and difficulty in 
attending to tasks can be success- 
fully employed using this model. 



Minimum wage or above. 



Hoiirly wages based on client product- 
ivity compared to an established 
production norm. 



Hourly wages based on product- 
ivity compared to an established 
production norm. 
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hour. At the average of 83.5 hours of work per month, the 
workers' average monthly gross income is $276. The results of 
Illinois supported employment indicate that persons with 
disabilities can successfully maintain their employment in the 
community wxth benefits that are comparable to those of 
no nhandi capped employees. 

Who Is Served in Illinois? 

The initial target population for the Illinois Supported 
Employment Initiative consists of those individuals with 
disabilities who traditionally have not been considered eligible 
for vocational rehabilitation services and who cannot obtain or 
maintain employment without ongoing support services. 

The Illinois Supported Employment Initiative is designed as 
an alternative to day-activity and shcl^-ered-employment 
programs. Owing to the Interest in utilizing supported 
employment to extend services to individuals previously excluded 
from integrated work opportunities, it has been important for 
service providers to collect data that define the range of 
participant characteristics. As of July 1986, 514 individuals 
have received supported employment services provided by 30 adult 
service agencies throughout Illinois. The mean age of these 
workers was approximately 30 years old, and 63% of the workers 
were male. The full-scale IQ scores of the participants range 
from 17 to 97, with a mean IQ score of 62. In addition, 
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secondary impairments were identified for 60% of the workers. 
Appoximately 55% of the participants lived independently or 
semi-independently; just over 7% resided in an intermediate care 
facility for developmentally disabled; and 5% lived in a 
community residenc:; facility. 

The vast majority of the workers had previously received some 
form of vocational training, ranging from high school vocational 
education courses to developmentcil training services. In 
addition, 63% of the individuals had previously worked in 
sheltered workshops, and almost 43% of the individuals had had 
previous experience in competitive employment but were unable to 
maintain their jobs. 

The Illinois Supported Employment Program (ISEP), which is 
based at the University of Illinois, provides several forms of 
assistance to rehabilitation personnel who are working with 
target employees, including technical assistance and program 
evaluation activities. 
Technical Assistance 

Technical assistance is provided on the basis of requests, 
identified needs, and general educational purposes of the funded 
programs, and is offered by telephone, mail, and site visit. 
From the beginning of the Project to date (7/1/8^ to 4/1/87), 
staff members have disseminated 510 pieces of literature by mail, 
provided telephone consultation on 144 occasions, visited each 
agency at least 4 times for a total of 175 visits, and have made 
132 visits to employment sites. In addition, staff members have 
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made 27 formal presentations on supported employment in Illinois. 

To reach a larger audience on topics of common concern to all 
model programs, group technical assistance is delivered through a 
workshop series. These two-day workshops have allowed 
participants (e.g., job coaches, job placement specialists, 
program coordinators, state department personnel) to select 
sessions of direct relevance to their particular roles in 
providing supported employment seminars. Topics addressed at 
past worksnops include marketing supported employment to the 
business community, teaching instructional strategi , using 
effective assessment instruments, and resource reallocation. 

Nationally recognized presenters have introduced workshop 
participants to a wide range of regional efforts in supported 
employment. Invited speakers have included Dr. Timm R. 
Vogelsberg, Pennsylvania and Vermont programs; Michael Collins, 
Washington and Oiegon programs; and Dr. Adelle Renzaglia, 
Virginia and Illinois programs. As the Illinois programs become 
increasingly implemented, the emphasis of the series has shifted 
to include greater contributions on the part of Illinois model 
programs as illur.trations of best practices in the field. 

Technical assistance has not been limited only to providing 
consultation for the model programs in Illinois. Because we 
realize the value of agency executive directors, state 
legislators, and others as resources to the supported employment 
initiative in Illinois, an effort is being made to unite these 
groups in support of the initiative. Toward this end, ISEP hosts 
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an annual meeting that focuses upon the benefits and costs of 
supported employment and highlights trends in employment. 

Program Evaluation 

The Illinois Supported Employment Project (ISEP) is 
evaluating model program degree of implementation and analyzing 
costs associated with supported employment. An important aspect 
of model program development is assessing the degree to which 
these model programs actually implement the characteristics that 
have been associated with important employment outcomes, such as 
average hours worked per month, hourly wage, and employment 
benefits, both monetary and nonmonetary. 

ISEP also e:;amines individual worker characteristics such as 
full-scale IQ scores, previous vocational training history, and 
residential living arrangements to monitor and evaluate the 
employment achievements of target employees. In addition, ISEP 
measures employment service characteristics such as the amount of 
time per month individuals receive vocational skills training, 
assessment, and case management services. 

Degree of Program Implementation 

In December 1985, field-based technical assistance was 
initiated using scheduled visits to each supported employment 
model demonstration program to collect implementation data. All 
visits followed the same structure, which was based on the 
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evaluation instrument— Degree of Implementation (DOT). During 
four rounds of visits, model programs (a) were introduced to the 
instrument and practiced scoring the DOT (Round 1 — December 1985 
to February 1986); (b) collected data on their programs (Round 
2--March 1986 to April 1986); (c) had the opportunity to react to 
the first year challenge of developing, implementing, and 
documenting progress in their efforts to establish supported 
employment in their respective communities (Round 3 — May 1986 to 
June 1986). The fourth round of visits (Deceiriber 1986 to 
February 1987) was designed to establish the growth and stability 
of the efforts :ind to study further the DOI in order to determine 
its validity and utility as a standard for evaluating supported 
employment programs. 

The Deqree-of-Implementation (DOI) Instrument . The DOI 
instrument is based on the research literature related to 
national model demonstration development of supported employment 
programs (e.g., projects in Illinois, Vermont, and Virginia) . 
The purpose of this instrument is to provide the Illinois 
Supported Employment Project (ISEP) with a standard against which 
to evaluate the implementation of state supported employment 
models and a method for assessing the technical assistance needs 
of individual model programs. 

The DOI instrument is designed to evaluate the process of 
developing and maintaining a supported employment model ♦ It can 
and has been used (a) to provide some structure for new supported 
employment model programs by informing them of relevant 
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activities identified through the literature, (b) to analyze the 
progress of the development of supported employirient programs and 
to document developmental efforts in relationship to a time 
frame, (c) to investigate and identify possible variables that 
might facilitate program development, (d) to analyze the proposed 
model in relationship to actual documented services being 
provided, and (e) to investigate the relationship of the model to 
selected outcome variables (e.g., hourly wage, tenure). The 
instrument lists 28 steps or indicators that are categorized 
according to five supportec? employment program components: (a) 
Job Survey and Analysis, (b) Job Match, (c) Job Acquisition and 
Maintenance, (d) Conjunctive Job Services/Interagency 
Coordination, and (e) Job Fit. Using written documentation 
provided by the model program, the evaluator scores the presence 
or absence of each indicator either as 0, 1, or 2, or NO 
(nonexistent), EMERGENT (present but incomplete), and YES 
(present and complete), respectively. Pre-established written 
criteria determine the scoring of each indicator and serve as a 
manual for the administration of the instrument. The overal] 
reliability obtained from the last set of ratings was .87 (Range 
= .75 to 1.00). 

Data collection results . The results of efforts at 
implementing the proposed model of supported employment are 
presented in Table 2. Level of implementation is expressed in 
quartiles. The first quartile (0 « 25%) is the lowest level of 
implementation and indicates the degree (percentage of DOT 
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activities) to which a particular project has been implemented. 
The fourth quartile (76-100%) is the highest level of program 
implementation. Table 2 provides the percentages for each 
quartile in each of three rounds of data collection. The most 
current data suggest that 87% of the model programs are in the 
top three qu-»rtiles of implementation and that the most growth 
has occurred in the second quartile, whereas the third and fourth 
quartiles have remained relatively constant. At this writing, 
13% of the programs are implementing 21 or more of the 28 



Table 2 

Percentages of Overall Scores by Quartile 
Degree of Implementation 



Quartile 


Number 

of DOT 
Activities 
Implemented 


March to 
April 
1986 
% 


May to 
June 
1986 
% 


December to 
February 
1987 
% 


1 (0-25%) 


0-7 


42 


30 


13 


2 (26-50) 


8-14 


21 


33 


47 


3 (51-75%) 


15-20 


27 


18 


27 


4 (76-100%) 


21-28 


9 


18 


13 



supported employment activities (fourth quartile). The same 
percentage of programs implement 7 or less activities (first 
quartile), whereas 47% of the programs implemented between 8 to 



23 



Introduction 
13 

14 activities (second quartile) and 27% of the programs 
implemented 15 to 20 activities {third quartile). Data on overall 
implementation over the six-month period indicate that the number 
of programs implementing more than 50% of the activities is 
increasing. 

The most frequently implemented activities are those that 
survey the community (^)l), task analyze potential jobs (#6), 
identify requisite skills (#8), assess and observe vocational 
skills (#12 and #1A), and reassess through observation 
maintenance of vocational skills (#26). 

Although these items represent the core of activities that 
most projects are implementing, they do not necessarily indicate 
activities that have produced the most desirable outcomes. For 
example, the identification of social skills and accompanying 
social skills assessment are implemented at a significantly lower 
rate than items related to vocational aspects of employment. 
Ironically, research literature indicates that persons with 
disabilities most often lose their jobs because of social skills 
deficits (Greenspan & Shoultz, 1981). These relationships can 
only be investigated by further study through correlational 
analysis. It is encouraging that more social skills assessments 
occurred in the last round than in previous rounds, as did more 
structured pre-placement observations. On the other hand, the 
lack of documeiitation to support a systematic procedure for 
matching job analysis information with assessment information 
indicates that there is still much improvement necessary in 
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activities within the job match component. 

It is also troubling that there is a lack of systematic 
training, data collection, and withdrawal. Only 37% of the 
programs implement the Job Acqusition and Maintenance component. 
Because effective systematic training and data collection 
strategies are critical to successful supported employment, staff 
selection and development activities must seek to improve 
procedures in this area. The low-level implementation of Job 
Acquisition and Maintenance activities may be attributed to the 
type of client being served by the model programs. There is some 
indication that there is an inverse relationship between level of 
employee functioning and DOI scores; in other words, the higher 
the DOI score, the lower the level of target employee functioning 
and vice versa (Trach & Rusch, 1987). 

Summary. The DOI data collection indicates that there has 
been a positive trend to increase the implementation of supported 
employment activities in the state of Illinois since June 1985. 
Job Survey and Analysis and Job Match are the most widely 
implemented components. The remaining three components- -Job 
Acquisition and Maintenance, Conjunctive Job Services/Interagency 
Coordination, and Job Fit--are implemented at consistently lower 
levels. Some possible reasons for nonimplementation of DOI 
activities include: (a) lack of documentation, (b) inability to 
implement because of staff resources or lack of technology, (c) 
staff resistance to change, (d) level of target employee 
functioning, and (e) philosophical differences. 
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The trends in program implementation over time raise some 
interesting questions^ such as whether the quality of services 
being provided have direct implication for attainment of 
favorable outcomes. 

Cost of Supported Employment 

Supported employment provides both monetary and nonmonetary 
benefits to ±ts service recipients c .id to the taxpayer. 
Potential monetary benefits to the individual service recipient 
are defined in part by the gross income earned by the worker 
while he or she is participating in supported employment. The 
benefits to taxpayers are defined in part by the taxes paid by 
the target employee and by the fact that the target employee does 
not rely upon traditional tax-supported day programming options, 
such as work activity and adult day care. 

The benefits of supported employment also can be examined in 
noncost terms. Because integration with co-workers is one 
component of the supported employment model, the number of new 
friendships developed, the opportunity for advancement within the 
work force, and the acquisition of additional duties reflect some 
of the social benefits that an individual may experience. The 
supported employment model clearly offers normal integrated work 
opportunities that sheltered work programs cannot. 
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Suit .a ry 

Today, more than in any period preceding recent legislation, 
we have an opportunity to change our goals and the methods we use 
to serve persons with disabilities. In Illinois, a group of 
selected persons with disabilities rarn more thui $100,000 each 
month and are finding friends and opportunities that many of 
America's nondisabled are enjoying. In this respect, Illinois 
leads the country no other state in America has provid.^d the 
person with a disability employment opportunities alongside 
nonhandicapped employees, nonsheltered employment, and 
recognition as in'''! vidua Is. 

References 

Greenspan, S., & Shoultz, B. (1981). Why mentally retarded 
adults lose their jobs: Social competence as a factor in 
work adjustment. Applied Research in Mental Retardation , 2 
(1), 23-38. 

Rehabilitation Act Amendments of 1986, 29 U.S.C. 701. 
Rusch, F. R., & Phelps, L. A. (1987). Secondary special 

education and transition from school to work: A iidtional 

priority. Exceptional Children , 53 , 487-49'2. 
Trach, J. S., & Rusch, F. R. (1987). Validation of an instrument 

f or evaluating supported employment programs: The Degree of 

Implementation . (This volume). 
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Supported Employment Program Development 
Degree of Implementation M.,aual 



John S. Trach, Frank R. Rusch, 
and 

Lizanne DeStefano 



Instructions to Users 

The Degree of Implementation is based on the premise that 
any person, no matter how disabled, has the right to work for 
wages in integrated employment settings. The Degree of 
Implementation (DOI) is an evaluation instrument that identifies 
those components necessary for establishing and maintaining a 
t>upported employment program. Unlike programs that label some 
persons as unemployable, this model is applicable to all 
disabilities, regardless of severity, because it describes a 
program that is flexible enough to accommodate varying levels of 
disability. 

The data obtained fr. n this instrument will allow program 
developers and evaluators to compare a specific supported 
employment program to national standards. Correlational studies 



o 2S 
ERLC 



DOI Manual 
18 

of DOI data with certain outcome measures (e.g., type of job, 
hours worked, salary earned) can illustrate program processes 
and gauge prrgram effectiveness. The DOI can provide direction 
for data-based staff development and identify areas within the 
program that are in need of further refinement. 

This manual provides operational definitions for the scoring 
system to be used in the administration of the Degree of 
Implementation. Exauonples of relevant documents and 
considerations are provided to illustrate the criteria for each 
item. 

Components of the Model 

The five components that constitute the model of supported 
employment upon which the DOI is based are described below. 

Community Survey and Job Analysis (Items 1-5). These 
activities are associated with surveying the community for 
potential job placement sites through telephone calls, mail 
correspondence, and personal contact. This component also 
involve.-^ identifying the vocational skills dad social- 
interpersonal behavior requisites for a particular job. 

The DOI recognizes nine occupational ^as (Table 1) as 
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appropriate employment opportunities for persons with 
disabilities. For the purpose of this instrument r valid 
employment opportunities do not, under any circumstances, 
include sheltered workshop employment, work activities, or adult 
day care. Some communities might not include all of the 
occupational areas. Such exceptions should be noted before 
scoring the DOI and will not prevent a program from }.eceiving a 
score of 2 on the item. Programs unwilling to develop job sites 
in certain occupational areas that are represented in the 
community can obtain a maximum score of 1 on DOI (see Item 1). 
Programs that have successfully placed the number of individuals 
that they have planned and contracted to place should be scored 
a 2 for subsequent DOI evaluations (i.e., later than 6 months 
after the start of the progrcon) . Programs that have changed 
sites or <?re developing additional sites are expected to repeat 
the entire Community Survey and Job Analysis component and 
should be scored accordingly. 

Job r4atch (Items 7-10). This component concerns assessing 
target employee characteristics in relation to job requisites 
and includes documenting the use of standardized norm- and 
criterion-referenced tests along with ecological inventories as 
the basis for making accurate judgments that result in a 
successful job match. 

Job Placement (first six months before Job Maintenance 
phase) (Items 11-16). Job placement refers to procedures 
utilized when training target employees to perform on the job. 
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Table 1 

Recomnended Categories for Job Development 



Light Industrial — work related to manufacturing 

a product or preparing a product for market 
(e.g., assembly benchwork, production line 
worker) 

Laundry — work related to laundering clothes or 

linens (e.g., towel machine operator, sheet 
ironer ) 

Warehouse - -work related to shipping and 
receiving goods (e.g., stocking, 
loading/unloading trucks, delivery person) 

J ani tor ia 1/Maintenance — work related to 

improving or maintaining a building's 
appearance (e.g. , janitor, maid, building 
repair person) 

Retail - -work related to selling merchandise or 
services to consumers (e.g., clerk, gas 
station attendant, grocery bagger) 

Grounds Maintenance — work related to 

maintaining grounds to be attractive, 
functional, and safe (e.g., lawn 
maintenance, gardening, leaf and snow 
removal, salting ice, removal of debris, 
trash collection, repair of sidewalks, 
painting) 

Food Service — work related to preparing and 

serving food to large numbers of people in 
an institutional setting/restaurant business 
(e.g., server, busboy, cook, dishwasher) 

Clerical — work related to processing 

information (e.g., file clerk, secretary, 
receptionist, typist, data processor) 

Health Care — work related to the provision of 

health care services in a hospital, hospice, 
nursing home, or patient's residence (e-g., 
nurse's aide, bed jitripper, lab technician, 
recreation therapist helper) 
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These procedures typically require vocational training 
techniques and job modifications to adapt the job to target 
employees' particular handicap(s), in addition to planning to 
maintain performance acquired through trailing, once the 
training period has ended. 

Job Maintenance (Items 17-21) . A primary consideration in 
supported employment is whether the target employee maintains 
his or her job. Evaluation and training activities are 
essential to helping the target employee to remain employed 
beyond the traditional "60-day work adjustment period." Job 
maintenance is conducted by reassessment of target employee 
performance, social validation of the quality of job 
performance, and modification of efforts to meet target employee 
and employer expectations. 

Related Job Services/Interagency Coordination (Items 
22-26). The items included in this component of the DOI relate 
to enhancing one's quality of life through multiple agency 
cooperation. The overall focus of this component is to ensure 
that the employee keeps his or her position in society. Related 
job services consist of the actual programs, individuals and 
subcomponents of participating agencies that provide the direct 
services needed to secure, train, and maintain a job placement. 
Interagency coordination convenes those agencies that function 
independently of each other, but provide necessary job services 
for a particular individual that might affect the job placement 
and retention of the target employee and the services within 
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each agency that work in conjunction with each other in order to 
attain work placement, train for and maintain work placement, 
and develop skills outside work placement that may promote or 
prohibit continued employment (e.g., social skills training and 
travel training provided by the enployee's guardians or 
residence managers). 
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COMMUNITY SURVEY AND JOB ANALYSIS 



It^ 1. Conducts a conmunity survey to identify potential 
jobs. 

2 Files contain telephone, personal, or correspondence 

contact documents with businesses in the local community 
that indicate two prospective employers in each 
occupational area.* 

1 — Files contain telephone, personal, and/or correspondence 
contacts with businesses in the local community that 
indicate at least one prospective employer in each of 
occupational areas. 

0 Businesses have been contacted in less than each of the 
occupational areas or documentation of community survey 
does not exist. 



Relevant Documents to Review 

Agency-completed surveys 
Telephone survey response 

questionnaires (Rusch & 
Telephone records related 

with employer 



Reference 

Rusch, F. R., & Mithaug, D. M. (1980). Vocational training for 
mentally retarded adults; A behavior analytic approach . 
Champaign, XL: Research Press. 



Programs unwilling to develop job sites in certain 
occupational areas that are represented in the community 
can only obtain a score of 1 on Degree of Implementation 
(see Table 1). Programs must document lack of expertise or 
financial resources to develop multiple occupational areas. 



records and narrative 
Mithaug, 1980) 

to interactions and discussions 
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Item 2. Compiles lists of businesses willing and not willing 
to employ individuals with handicaps. 

(Hote: If r-ton 1 is scored "0" Item 2 must be scored "0". 

2 — Documented written list has been compiled of businesses 

that are willing and not willing to employ individuals with 
handicaps in all of the occupational areas (Table 1; Item 
1). 

1 — Documented written list has been compiled of businesses 

that are willing and not willing to employ individuals with 
handicaps in at least 50% of the occupational areas. 

0 No list exists, or the list is limited to less the' 50% of 
the occupational areas or less than 50% in the occupational 
areas identified. 



Relevant Documents to Review 

Written list of businesses willing and not willing to 

employ individuals with handicaps 
Letters to and from b sinesses 
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Item 3. Obtains employer-validated job descriptions. 

2 — Actual job descriptions, which have been developed by 

employers, are avaiTable for each of the occupational areas 
listed in Item 1. 

Actual job descriptions, which have been developed by 
employers, are available for 50% of the occupational areas 
listed in Item 1. 

0 Less than 50% of the job descriptions in the occupational 
areas are available. 



1 — 



Relevant Documents to Review 

Dated job descriptions from local businesses 
Agency records indicating job coach has validated the job 
position 

If a position has been created for a target employee, there 
must be documentation that the position is essential to 
the day-to-day operations of the business 
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ItCTi 4. Conducts job analysis of targeted jobs (enclaves/work 
sites ) • 

2 INDIVIDUAL PLACEMENT - Complete job analysis is written for 
at least one position in each of the occupational areas, 

ENCLAVE or WORK CREW PLACEMENT - Complete job analysis is 
written for the target employment site(s) as well as one 
additional employment site,* 

1 INDIVIDUAL PLACEMENT - Complete job analysis is written for 
one or more positions in at least 50% of th3 occupational 
areas (at least one targeted enclave or work crew site). 

ENCLAVE or WORK CREW PLACEMENT - Complete job analysis is 
written for only the target employment site(s), 

0 — INDIVIDUAL PLACEMENT - No job analysis is available or the 
existing job analysis addresses less than 50% of the 
occupational areas (for none of the targeted enclaves or 
work crew sites). 

ENCLAVE or WORK CREW PLACEMENT - No job analysis is 
available fcr any of the target employment site(s) or the 
existing job analysis is inadequate,* 



Relevant Documents/Considerations to Review 

Job coach actually performed the duties associated with 
target jobs 

Job coach has documented target job based upon interviews 

and actual observation 
Job Analysis Form (Martin, 1986) lists tasks associated 

with work station 
List of necessary accessories (e.g., uniforms) 
Mobility and safety requirements 

Reference 

Martin, J. E. (1986). Identifying potential jobs. In F. R- 

Rusch (Ed.), Competitive employment issues and strategies 
(pp. 165-185). Baltimore: Paul H. Brookes. 



No more than eight individuals may be placed in a cdngle 
enclave, and the number of individuals with handicaps 
employed on a mobile work crew may not exceed the number of 
nonhandicapped employees. 
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Item 5. Identifies job-specific work performance skills, 

including necessary job modifications (Chadsey-Rusch & 
Rusch, in press). 

2 Complete updated (within last 6 months) list exists of 
job-specific work performance skills in each of the 
occupational areas (targeted enclaves/work sites), 
including job modifications. 

I Complete list exists of job-specific work performance 

skills, including job modifications, for at least 50% of 
the occupational areas (targeted enclaves/work sites)- 

0 No list is available or the existing list of job-specific 
work pel ormance skills, including job modifications, are 
available for less than 50% of the occupational areas 
(targeted enclaves/work sites). 



Relevant Documents to Review 

Restructure sequence of tasjs. 
Reorganized work space 
Redesigned entrances/exits 

Proper use of a specific tool/macv^ine (e.g., wrench, 

buffer) 
Visually inspect a product 
Discriminate "clean" and "not clean" 



Reference 

Chadsey-Rusch, J. C, & Rusch, F. R. (in press). The ecology 
of the workplace. In R. Gay lord-Ross (Ed.), Vocational 
education for persons with special needs . Palo Alto, CA: 
Mayf ield. 



DOI Manual 



28 



Item 6. Identifies job-specific social-interpersonal skills. 

2 Complete list is available of required social-interpersonal 
skills in each of the occupational areas- 

1 Complete list is available of required social-interpersonal 
skills for at least 50% of the occupational areas. 

0 — No list is available or the list addresses less than 50% of 
the occupational areas. 



Considerations for Skill Areas 

Answers telephone appropriately while at work or in public 
places 

Speaks clearly enough to be understood or can sign to 

communicaLe needs 
Responds appropriately and immediately after receiving an 

instruction 

Responds to an instruction requiring immediate compliance 
Initiates contact with supervisor when an assigned 

task cannot be done 
Responds to instruction from various supervisors 
Works without displaying minor disruptive behaviors (e.g., 

interruptions) 

Works without displaying major disruptive behaviors (e.g., 
arguments) 



Reference 

Rusch, F. R. , Schutz, R. P., Mithaug, D. E., Stewart, J. E., & 

Mar, D. (1982). Vocational assessment and curriculum guide 

(VACG). Seattle, WA: Exceptional Education. 
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JOB MATCH 

Item 7. Administers standardized vocational assessment 
instrument to evaluate %(rork performance skills. 

2 — All target employees have been administered at least one 
standardized vocational assessment instrument to evaluate 
work performance skills within 30 days of their enrollment 
in the program. 

1 — At least 50% of all target employees have been administered 
at least one standardized vocational assessment instrument 
to evaluate work performance skills within 30 days of their 
enrollment in the program. 

0 — Less than 50% of all target employees have been 
administered at least one standardized vocational 
assessment instrument to evaluate work performance skills 
within 30 days of their enrollment in the program. 



Acceptable Assessment Instruments 

Vocational Assessment Curriculum Guide (VACG), (Rusch, 

Schutz, Mithaug, Stewart, & Mar, 1932) 
San Francisco Vocational Competency Scale (Levine & Elzey, 

1968) 

Vocational Eehavior Checklist (Walls, Zane, & Werner, 1978) 



References 

Levine, S., & Elzey, F. F. (1968). San Francisco vocational 
competency scale . New York: The Psychological 
Corporation. 

Rusch, F. R., Schutz, R. P., Mitnaug, D. E., Stewart, J. E., & 

Mar, D. (1982). Vocational assessment and curriculum guide 
(VACG). Seattle, WA: Exceptional Education. 

Walls, R., Zane, T., & Werner, T. (1978). Vocational behavior 
checklist . Morgantown, WV: West Virginia Rehabilitation 
and Research Center. 
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Item 8. Administers standardized assessment to evaluate 
soc. ^-interpersonal skills. 

2 All target employees have a record of at least one 

standardized assessment of social-interpersonal skills 
covering the domains of communication, daily living skills, 
socialiEation, and motor skills in their files within 30 
days of their enrollment in the program. 

1 At least 50% of all target employees have a record of at 
least one standardized assessment of social-interpersonal 
skills in their file within 30 days of their enrollment in 
the program. 

0 Less than 50% of all target employees have a record of at 
least one standardized assessment of social-interpersonal 
skills in their file within 30 days of their enrollment in 
the program. 



Acceptable Assessment Instruments 

Vineland Adaptive Behavior Scales (Sparrow, Balla, & 

Cicchetti, 1984) 
Inventory for Client and Agency Planning (ICAP) (Bruininks, 

Hill, Weatherman, & Woodcock, R. W. , 1986). 
Scal es of Independent Behavior (Bruininks, Woodcock, 

Weatherman, & Hill, 1984) 
AAMD Adaptive Behavior Scales (Nihira, Foster, Shellhaas, & 

Leland, 1975) 



References 

Bruininks, R. H., Hill, B \, Weatherman, R. F., & Woodcock, 
R. W. (1986). In ry for client and agency planning . 
Allen, TX: Developmental Learning Materials/Teaching 
Resources. 

Bruininks, R. H., Woodcock, R. W. , Weatherman, R. F. , & Hill, 
B. K. (1984). Scales of independent-Behavior . Allen, 
TX: Developmental Learning Materials/Teaching Resources. 

Nihira, K. , Foster, R. , Shellhaas, M. , & Leland, h'. (1975). 
Manual for AAMD Adaptive Be avior Scaxe . Washington, 
D. C*: American Associatioi on Mental Deficiency. 

Sparrow, S. S., Balla, D. A. , & Cicchetti, D. V. (1984). 

Vinoland Adaptive Behavior Scales . Circle Pines, MN: 
Arr.erican Guidance Service. 
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Item 9. Observes work performance and social-interpersonal 
skills on the job. 

2 Observational records are available for all target 

employees within 30 days of actual job placement. These 
records must include at least two observations in which one 
is obtained from the target job. The second can be from 
any other setting. Work performance, social-interpersonal 
skills, and other behaviors identified in the job analysis 
(e.g., grooming, mobility ski] Is) must be included in both 
observations. 

1 Observational records are available for all target 

employees within 30 days of actual job placement. These 
records include only one documented observation (i.e., 
observation from target job). Work performance, 
social-interpersonal skills, and other behaviors identified 
in the job analysis (e.g., grooming, mobility skills) must 
be included in both observations. 

0 — No documented observation exists for one or more targeted 
employees after 30 days of actual job placement. 



Relevant Documents to Review 

Job coaches notes from job site 

Vocational counselor's observation at the workshop 
Agency-developed observation forms/system 
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Item 10. Determines match of target employees' 

strengths/weaknesses in relation to alternative jot) 
placements** 

2 Each target employees' abilities have been documented in 
relation to two alternative jobs** within 30 days of 
assessment and observation. Documentation must consider 
Items 6 and 7 in relation to Items 8, 9, and 10. 

1 — At least 50% of the target employees' abilities have been 
documented in relation to two alternative jobs, or each 
target employee has only one job alternative documented. 

0 — Less than 50% of the target employees' abilities have been 
documented in relation to two alternative jobs, or at least 
50% of all target employees have only one job alternative 
documented. 



Relevant Documents to Review 

Decision tree for job match 

Meeting notes from job placement meeting and/or 
Individual Program Planning (IPP) 
Individual Habilitation Plan (IHP) 
Individualized Written Rehabilitation Plan (IWRP) 



This item focuses upon the best possible job match while 
assessing strengths and weaknesses in order to guide 
programming decisions. This item does not suggest that 
someone is unonployable or even less employable. 
Alternative jobs can only be community based. Sheltered 
workshop employment or work activities cannot be considered 
one of the alternatives for scoring this item. 
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JOB PIACKMKNT 

(First six months before Job Maintenance phase) 

Item 11. Evaluates target employees' per£omance to determine 
training needs. 

2 — All target employees' records include baseline data for 

work performance and socir 1-interpersonal skills (at least 
one data sheet for each scill area). These records are 
active to within two wee\s. 

1 — At least 50% of all target employees' records include 

baseline data for work performance and social-interpersonal 
skills (at least one data sheet for each skill area), or at 
least 50% of the records are more than two weeks old during 
Job Plac^nent phase. 

0 — Less than 50% of all target employees' records include 

baseline data for work pei^formance and social-interpersonal 
skills, JT more thcin 50% of the records are older than two 
weeks during Job Placement phase. 



Relevant Documents to Review 

Job coaches' files, including current task analysis, 

observation, and recording forms, and graphs. 
Individualized Written Rehabixitation Plan (IWRP) 
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Item 12. Utilizes behavior management strategies. 

2 — All target employee records include specific behavioral 

management strategies for each skill that was determined in 
Item 11 to require additional training. 

1 — At least 50% of all target employee records include 

specific behavioral management strategies for each skill 
that was determined in Item 11 to require additional 
training. 

0 — Less than 50% of axl target employee records include 

specific behavioral management strategies for each skill 
that was determined in Item 11 to require additional 
training. 

Relevant Documents to Review 

Job coaches' files include behavior management plans that 
refer to training procedures and their effects on the 
target behavior 
Completed behavioral observation forms and/or grc lis 
Staffing reports 
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Item 13. Restructures job to adapt to target employees' 
skills. 

2 — When necessary, target employee records include a plan for 
job redesign, including setting modification, task 
redesign, and equipment modification in addition to ongoing 
behavioral analysis.* 

1 - - Agency and employee records indicate that a current work 
order /plan to address examples lisced above is pending 
(work order must be no older than 30 days). 

0 — Job redesign has not been considered for target employee 

who could benefit, or promised modifications/redesign have 
not been made within 30 days. 



Relevant Documents/Modifications to Review 

Ramp installed for accessibility to worksite 
Jig used for assembly 
Co-worker pacing prompts 
Job sequence modified 
Lighting enhanced 



*If documented that no modifications are necessary, score 2. 
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Item 14 • Develops a plan to maintain acceptable levels of 
perfomiance acquired through on-the-job training. 

2 — Evaluates, by direct observation, the degree to which 
target employees rely upon supervision to complete all 
aspects of a job. After evaluation, the job coach develops 
individual maintenance plans for all areas of target 
employees' performance that rely upon a job coach for 
supervision. The plan must contain provisions for 
withdrawing supervision or transfarring supervisory 
responsibility to the emDloyer. This evaluation and 
subsequent plans must be developed for all target employees 
within two to four months of employment. 

1 — At least 50% of all target employees have been evaluated by 
direct observation and have individual maintenance plans, 
as described above, after two to four months of employment. 

0 — Less than 50% of all target employees' have been evaluated 
by direct observation and have individual maintenance 
plans, as described above, after two to four months of 
employment or plans have not been completed after four 
n.'^nths of employment. 



Relevant Documents to Review 

Written instructions related to fading assistance (i.e., 
prompts, preinstruction, job coach assistance, 
reinforcement schedule) 

Co -worker /Follow- up contact sheets 

Co-worker reinforcement plan 

Individual maintenance plan 

On-site contact sheets 



ERLC 



47 



DOI Manual 



37 



Item 15. Develops plan for support services during Job 
Maintenance phase. 

2 All target employees' records include, within four months 
of employment, a detailed written plan for follow-up 
services to occur throughout the first year. This plan 
must include the type of services needed, the personnel who 
are responsible, the schedule for delivery of services, and 
how to evaluate the services. 

1 At least 50% of target employees' records include, within 
four months of employment, a detailed written plan for 
follow-up services as described above. 

0 Less than 50% of target employees' records include, within 
four months of employment, a detailed written plan for 
follow-up services. 



Relevant Documents to Revie w 

Follow-up plan that contains a schedule of phone contacts 
and site visits on a daily and/or weekly basis (Rusch, 
1986) 

Detailed written plan 



Reference 

Rusch, F. R. (1986). Developing a long-term follow-up 

program. In F. R. Rusch (Ed.), Competitive employment 
issues and strategies (pp. 225-232 ) . Baltimore: Paul H. 
Brookes. 
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Item 16* Obtains feedback from employer /supervisor through work 
performance evaluations. 

2 — For each target employee currently in job placement, there 
exists an evaluation of the quality of his or her 
performance on the job. This eveluation must be conducted 
monthly for the first three months after initial job 
placement and as often as is warranted during the Job 
Placement phase. The statement should include a 
quantitative rating of strengths and weaknesses which must 
be obtained from the employer or a supervisor who has 
personnel evaluation responsibilities. 

1 — For at least 50% of all target employees currently placed, 
there exists an evaluation of the quality of performance on 
the job as described above. 

0 For less than 50% of all target employees currently placed, 
there exists an evaluation of the quality of performance on 
the job as described above. 



Relevant Documents to Review 

Worker Performance Evaluation Form (WPEF) (White & Rusch. 
1983) 

Company Personnel Evaluation Form 

Worker performance evaluation form mutually agreed upon by 
employer and training staff 

Reference 

White, D. M., & Rusch, F. R. (1983). Social validation in 
comp3titive employment: Evaluating work performance. 
Applied Research in Mental Retardation . 4, 343-354. 
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JOB MAIHTENANCE 

(continuous activity after Job Placement phase) 

Item 17. Ccxnpares target employees* work performance and 

social-interpersonal skills to co-workers* behavigf 
through monthly observation. 

2 — Job coaches' records indicate that all target employees and 
one co-worker who performs similar tasks have been observed 
at least once per month beginning with the first month 
after job placement and continuing throughout the 
employment period. These observations should relate 
directly to work performance and social-interpersonal 
skills identified in Item 9. 

1 — Job coaches' records indicate that at least 50% of all 
target employees and one co-worker who performs similar 
tasks have been observed at least once per month as 
described above. 

0 Less than 50% of all target employees and one co-worker who 
performs similar tasks have been observed at least once per 
month. 



Relevant Documents to Review 

Direct observation and recording forms (White, 1986) 
Reference 

White, D. M. (1986). Social validation. In F. R. Rusch (Ed.), 
Competitive employment issues and strategies (pp. 199-213 ) . 
Baltimore: Paul H. Brookes. 
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Item 18. Obtains feedback from employer/ supervisor through work 
performance evaluations after job placement period. 

2 — For each target employee currently in job placement, there 
exists an evaluation of the quality of his or her 
performance on the job. This evaluation must be conducted 
at least at often as all regular employees are evaluated or 
every six months. The statement should include a 
quantitative rating of strengths and weaknesses which must 
be obtained from the employer or a supervisor who has 
personnel evaluation responsibilities. 

1 — For at least 50% of all target erap^oyees currently placed, 
there exists an evaluation of tha quality of performance on 
the job as described above. 

0 — For less than 50% of all target employees currently placed, 
there exists an evaluation of the quality of performance on 
the job as described above. 



Relevant Documents to Review 

Worker Performance Evaluation Form (WPEF) (White & Ruscn, 
1983) 

Company Personnel Evaluation Form 

Worker performance evaluation form mutually agreed upon by 

employer and training staff 
Employer policy for personnel evaluations 



White, L. & Rusch, F. R. (1983). Social validation in 

competitive employment: Evaluating work performance. 
Applied Research in Mental Retardation , 4, 343-354. 
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Item 19. Provides on-the-job training to meet 
employers ' /supervisors ' expectations . 

2 All employees' records reflect continuous efforts to 
utilize behavior management strategies in response to 
employer /supervisor ratings (see Item 18). 

1 At least 50% of employees' records reflect continuous 
efforts to utilize behavior management strategies in 
response to employer/supervisor ratings (see Item 18). 

0 — Less than 50% of employees' records reflect continuous 
efforts to utilize behavior management strategies in 
response to employer/supervisor ratings (see Item 18). 



Relevant Conditions 

Supervisor believes that work is of unacceptable quality 
Employer does not believe that production is adequate 
Employer believes employee is disruptive 



Relevant Document to Review 

Detailed written plan to address employer/supervisor 
concern and describe changes* 



The change statement should include the reason(s) for the 
change and revised training and evaluation plans. 
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Item 20. Assesses target employees' work performance skills 
annually with standardized vocational assersroent 
instruments. 

2 — Within 12 to 14 months of the previous assessment, each 

target employee placed by the prograrr has been administered 
the same vocational assessment instrument previously 
administered to evaluate work-performance skills. 

1 — For at least 50% of all target employees placed by the 

program, standardized assessment of work performance skills 
has been conducted within 12 to 14 months of the previous 
assessment. 

0 Standardized assessment of work performance skills has been 
conducted for less than 50% of all target employees, or for 
any one employee more than 14 months after the previous 
assessment. 



Acceptable Assessment Instruments 

Vocational Assessment Curriculum Guide (VACG), (Rusch, 

Schutz, Mithaug, Stewart, & Mar, 1982) 
San Francisco Vocational Competency Scale (Levine & Elzey, 

1968) 

Vocational Behavior Checklist (Walls, Zane, & Werner, 1978) 



References 

Levine, S., & Elzey, F. F. (1968). San Francisco Vocational 
Competency Scale . New York: The Psychological 
Corporation. 
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Item 21. Assesses target employees' social-interpersonal skills 
euinually with standc^rdized assessment instruments. 

2 Within 12 to 14 months of the previous assessment, each 
eTiployee placed by the program has been administered the 
same standardized assessment of social- interpersonal skills 
previously administered to evaluate the domains of 
communicatiOAi, daily living, socialization, and motor 
skills . 

1 — For at least 50% of all employees placed by the program, 

standardized assessment of social-interpersonal skills has 
been conducted within 12 to 14 months of the previous 
assessment. 

0 -- Standardized assessment of social-interpersonal skills has 
been conducted for less than 50% of all employees, or for 
any one employee more than 14 months after the previous 
assessment. 



Acceptable Assessment Instruments 

Vineland Adaptive Behavior Scales (Sparrow, Balla, & 

Cicchetti, 1984) 
Inventory for Client and Agency Planning (ICAP) (Bruininks, 

Hill, Weatherman, & Woodcock, 1986). 
Scales of Independent Behavior (Bruininks, Woodcock, 

Weatherman, & Hill, 1984) 
AAMD Adaptive Behavior Scales (Nihira, Foster, Shellhaas, & 

Leland, 1975) 
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RELATED JOB SERVICES/INTERAGENCY COORDINATION 

Item 22. Identifies potential agencies that provide employment 
services . 

2 An up-to-date list exists that identifies at least three 
potential age-f-.oies that provide employment services (a 
contact with the potential agency to provide employment 
services has been made within 30 days). The list includes 
name of agency, address, phone number, contact person, and 
potential services the agency can provide, 

1 """" list, as described above, of two potential agencies 

exists, or any one of the contacts with the agencies is 
older taan 6 months . 

0 - ' No list exists or any of the contacts with any of the 
agencies is older than 1 ye ^ . 



Relevant Agencies to Incl iiJ^ 

Local Department cf Vocational Rehabilitation 

State Department of \/ocational Rehabilitation (e.g., 

Illinois Department of Rehabilitation Services - DORS) 
Association of Retarded Citizens (ARC) 
Parent Groups (e.g.. Parent CHAIN) 
Community Colleges 
Trade Schools 
Local Education Agency 
State Education Agency 
Labor Unions 

Job Training partnership Association 
Vocational Evaluation Centers 
Local Rehabilitation Facility 
Private Industry Council (PIC) 
Targeted Job Tax Credit (TJTC) 
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Item 23. Identifies employinenc services within each potential 
agency (see Item 21) that could promote continuation 
in present placCTient. 

2 For each target employee currently placed, a list of 

services is developed that could be provided by agencies 
identified in Item 22 to enhance job performance and 
promote continuation of placement. 

- For at least 50% of the target employees currently placed, 
a list exists as described above. 

0 A list of services exists for less than 50% of all target 
employees placed or the existing list does not meet above 
specifications . 



Relevant Considerations to Review 

Advocacy ( ARC ) 
Evaluation 
Support groups 

Transportation and travel training 

On-the-job training (OJT) 

Union representation/participation 

Tax incentives (TJTC) 

Wages (OJT) 
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Item 24. Identifies agencies able to provide employment- rrlatea 
services • 

2 — An up-to-date (a contact with the agency that can provide 
employment services has been made within iO days) list 
exists that identifies at least three agencies that could 
provide employment-related services (e.g., transportation, 
financial advisement, medical treatment) • The list 
includes name of agency, address, phone number, contact 
person, and potential services the agency provides • 

1 — A list, as described above, of two potential agencies 
exists or any one of the contacts with the agencies is 
older than six months • 

0 — No agency has been contacted or any of the contacts with 
the agencies is older than one year. 



Relevant Agencies to Include 

Centers for Independenc living 

Social Security Administration (5'SA) 

Association for Retarded Citizens (ARC) 

Parent Groups (e.g., parent CHAIN) 

Residential facility (e.g.. Group Home) 

Departments of Mental Health 

Departments; of Developmental Disabilities 

University Affiliated Facilities 

Local Education Agencies 

Cominunity College System 

Public Aid 
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Item 25. Identifies enqployment- related services within each 
agency that could promote continuation in present 
placement. 

2 For each target employee currently placed, a list of 

services is developed that could be provided by agencies 
identified in Item 24 to enhance job performance and 
promote continuation of placement. 

1 For at least 50% of the target employees currently placed, 
a list exists as described above. 

0 A list of services exists for less than 50% of a''l target 
employees placed, or the existing list does not meet above 
specifications . 



Relevant Considerations to Review 

Housing 
Advocacy 

Transportation and travel training 
Financial Advisement 
Residential coordination 
Leisure-time consultation 
Health-care services 
Support groups 
Evaluation 

Psychological services 
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Item 26. Revises Individualized Written Rehabilitation plan to 
include interagency cooperation that focuses upon 
long-term employment through case management. 

2 For each target employee currently placed, a detai "'^d 

written plan exists that specifies the agencies involved, 
the services they have agreea to provide, reporting and 
feedback procedures, and budgetary agreements. Tt is 
expected that this plan will be developed in an interagency 
meeting. 

1 For at least 50% of all target employees currently placed, 
a detailed written plan exists as described above. 

0 For less than 50% of all target employees currently placed, 
a detailed written plan exists oi is not in accordance with 
the above description. 



Relevant Documents to Review 

Minutes of interagency case coordination meetings 
Written plan for interagency staffing 
Individualized Written Rehabilitation Plan 
Individual Habilitation Plan (IHP) 
Cooperative agreements with agencies 
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Validation of an Instrument for 
Evaluating Supported Employment Programs: 
The Degree of Implementation 

John S, Trach 
and 

Fiank R. Rusch 



The current emphasis on employing persons with severe 
disabilities in integrated settings has resulced in a 
proliferation of vocational service delivery models. These 
models have evolved from research and development activities 
over the past several years (cf. Bates & Pancsofar, 1981; 
Bellamy, Sheehan, Horner, & Boles, 1980; Rusch & Mithaug, 1980; 
Vogelsberg, Williams, & Fcx, 1981; Wehman, 1981). One of the 
mere promising models is the supported employment model (Bates & 
Panscofar, 1983; Rusch, 1983; Vogelsberg, 1984; Wehman & Kregel, 
1985; Wilcox & Bellamy, 1982). 

Rusch (1986) identified five nationally recognized supported 
employment models, including university-based programs (Moss, 
Dineen, 6t Ford, 1986; Wehman, 1986), school-based programs 
(Bates, 1986), and adult service agency programs ( Lagomarcino , 
1986; Vogelsberg, 1986). There is some variation in terminology 
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and design across supported employment models that have bee'^ 
implemented, but there also appear to be comiTion activities that 
can be used to define these models. 

Although there appears to be some agreement regarding the 
components of the supported employment model among model program 
innovators, these components have not been validated. Because 
program developers are at risk of adopting practices that may 
not be impo'-tant to overall program effectiveness, the primary 
purpose of this study was to validate reported components of the 
supported employment programs using standard validation 
procedures ( Standards for Educational and Psychological Testing , 
1985) . 

Through a review of research literature and an analysis of 
existing supported e.aployment programs, this investigation 
identified the following components in the supported empl D^Tnent 
model: (a) job survey and analysis, (t) job match, (c) job 
acquisition and maintenance, (d) conjunctive job 
services/interagency coordination, and (e) job fit. These 
components formed the model that served as the basis for 
developing statewide replications in Illinois. The instrument 
developed in this study is referred to as the Degree of 
Implementation (DOI). Validation of this iiistrument is 
important because the instrument can function as a formative 
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and summative evaluation tool* It can also serve as a valid 
assessment device for data-based staff and program development 
by providing program directors, coordinators, and direct service 
providers (e.g., job coach) with a clear description of what 
activities are involved in providing supported employment 
services. 

Components of the Model 

The five components that constitute the model of supported 
employment upon which the DOI is based are described below. 

Job survey and analysis . Job survey and analysis refers co 
activities associated with surveying the community for potential 
job placement sites through phone calls, correspondence, and 
personal contact, and identifying requisi^,e vocational skills 
and social behavior. 

Job match . Job match refers to assessing client 
characteristics in relation to job requisites. 

Job acquisition and maintenance . Job acquisition refers to 
procedures utilized in training clients to perform on the job; 
job maintenance refers to procedures utilized in assisting the 
individual in retaining the target job once he or she learns the 
job. These procedures typically utilize vocational training 
techniques, job modifications to adapt the job to clients* 
particular handicap(s), and planning to maintain performance 
acquired through training once the training period ended. 

Conjunctive job services/ interagency coordination . 
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Conjunctive job services comprise the actual programs, 
individuals, and subcomponents of participating agencies that 
provide the direct services needed to secure, train, and 
maintain a job placement. Interagency coordination convenes 
those agencies that function independently of each other, but 
provide necessary job services for a particular individual. 
These services and efforts incorporate (a) the ongoing 
coordination of all agencies involved with the client that 
provide services that might affect the job placement and 
retention, and (b) the services within each agency that work in 
conjunction with each other ii order to attain work placement, 
train for work placement, maintain work placement, and develop 
skills outside the work placement that may promote or prohibit 
continuation in placement (e.g., social skills training and 
travel training provided by the client's guardians or residence 
managers) . 

Job fit . Assessment of the match between the individual, 
the job, the quality of work, and the other life settings 
indicates the fit of the job to the individual. Joo fit can be 
determined by reassessment of client performance during and 
after training, socially validating the quality of job 
performance, and modifying efforts to meet client, employer, and 
parent or guardian expectations. 

Two questions were addressed m this study. The first 
question relates to construct validity and focuses upon the 
relationships among the five components of the Degree of 
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Implementation and between each component and the overall DOT 
score. The second question attempts to collect further evidence 
of construct validity by examining the relationship between 
component and overall DOI scores and selected outcomes, namely 
IQ, wages, and time spent in job development. 

Method 

Instrumentation 

The Degree of Implementat \on (DOI) is an instrument designed 
to evaluate the degree to which program developers have 
implemented the model (see Figure 1). The instrument lists 28 
activities of the model which were categorized into five generic 
components: (1) Job Survey and Analysis, (2) Job Match, (3) Job 
Acquisition and Maintenance, (4) Conjunctive Job 
Services/Interagency Coordination, and (5) Job Fit, 

Scoring . To evaluate each supported employment program, the 
University of Illinois staff scored the presence (absence) of 
each of the activities. A three-part scoring system was 
utilized. The scoring system required classifying an activity 
as nonexistent (score =0), emergent (score = 1 ) , or present 
(score =2). For example, if a program had documented the 
development of individualized training plans for at least 50% of 
the individuals placed at employment sites (Item #16), that 
activity would have been scored 1, or emergent- If that same 
program had documented the development of training plans for all 
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of the individuals placed at the employment sites, that activity 
would have been scored 2, or present, A manual was developed 
with pre-established written criteria to determine the scoring 
of each component's presence. 

General Procedures 

Model program development . The model programs included 33 
adult vocational service aaencies funded by the State of 
Illinois to implem.ent the supported employment model. These 
programs were developed as new services to complement existing 
vocational service^, in each agency. Agencies hired new project 
staff to coordinate supported employment efforts and defined a 
new position (job coach) to provide direct services. Model 
programs became operational between July 1, 1985 and February 
28, 1986. Client enrollment in each program varied due to 
actual funding, hiring new staff, adopting changes in 
programming policies, and overall acceptance of individuals with 
handicaps by community employers. 

Model programs were established primarily in urban and 
suburban areas with about 25% of the total number of projects 
located in rural areas. Each program served from 4 to 30 
individuals with severe disabilities who had previously been 
excluded from community placement due to the severity of their 
handicap. 

Technical assistance . Technical assistance was provided to 
model programs implementing the supported employment model. 
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Figure 1 

Degreg of Implernent:at.XQn Pro " to col 



SURRORTED EMPLOYMENT 
DEGREE OF IMPUEME JTAT I ON 

The degree uf implementation fotrc may be completed for each program by the project 
director as part of job trainer supervision or university personnel on a site visit 
to deliver technical assistance. It will bv^ necessary to examine job trainer logs and 
other program documentation in order to complete the form. 

The instrument utilizes a 3-point scoring system to rate both the frequency and 
quality of the task performed. The point system works as follows: 

2 ' YES - The activity is completed as regularly as mandated or as often as necessary 
at acceptable level of quality. 

1 * EMERGEbPT * The activity is being carried out but with less frequency or quality 

than is desirable. Technical assistance/staff development is indicated, 

0 - NO ' The activity is not carried out or is done so inappropriately. Those items 
considered "not applicable" to a program should be scored 0 then explained. 
Technical assistance/staff development is strongly indicated. 

Job Survey and Analysis NO EflERGEHT ^LS 

1. Conducts a coiiunt/ survey fDr potential 30D5. 0 I 2 

^. DeY?lcp5 a list of coipanieB/fiaencies willing t: eioloy 'hents. 0 1 ? 

3. Targets specif:: jobs withi. particalar coipany/aqe'^cy. 0 1 3 

^. Sc'Ciall/ validates targeted jobs. 0 1 I 

I. Deter<^ines Nhi:h coBpany/agency is appropriate ^:r placeier^ 0 I 5 
6. "^asl^ analyres targeted jobs witHin couipanies. 0 1 2 

Socialiy validates task analysis ^cr particular job. 0 1 2 

9. Ident/ies ""equ^site skiils cr modifications necessary for K'b. 0 1 ^ 
^. Socially validates necessary vrcationai sMlls. 0 1 5 

10. Deterwines necessary social survival shils (e.g., appropiiate coiiunication snlls, 

transportation sMlls). 0 ! 3 

II. Socially validates social survival skills. 0 1 c 



Fxgure 1 (cont. ) 
Job Match 

12. ^5585565 client's vocational shlls with standardized assessaient (e.g., Vocational Assesscent 
and Curncului 6(tide). 

13. A55e55e5 client's social skills nith standardized assesstent (e.g., Vineland Social flaturity 
Scale). 

Ih. Assesses client's vocational and social skills through observation. 

Ij. Detertines latch of client's characteristics to the job requi^^ite skills. 

Job Ac<mi3ition and Maintienance 

16. Utilizes applied behavior analysiB. 

17. Modifies job to adapt to particular client's handicap. 

18. Proposes plan to laintaj^ the level of performance acquired through training 
{e.g., seif-ionitoring techniques). 

!9. Proposes plan for follow-up services. 

Conjunctive Job Services / Interagency Coordination 
20. Identifies po* Mai agencies to provide vocational services. 
2\. Identifies potential agencies to provide vjcia^ services. 

22. Identifies services mthm each potential agency that pronote continuation in present placeien 

c3. Proptses plan for agency CDcrdination and job services froii each agency to be provided in 
conjunctir/n «itn job training, 

jQh Fi t 

^'t. Reassess client's vocational skills periodically with star.dardized assessment instri.fle'-ts. 
f^eassess client's social survival srills periodically Nith standardized assessrent instruierts 
Peassess client's social and vocational skills through •on'.hly observation. 
Socia:l> validates the quality of performance op the job. 

Modifies job training to teet client, etployer, and parent qudroiai dxpectatic-ns. 
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This assistance was provided by the Univers:ty of 1 inois. 
Technical assistance activities were provided via telephone, 
mailings, and site visits. Three site visits were made to each 
program during the first year. In addition, five seminars were 
offered to model program personnel throughout the first year. 
The goal of the technical assistance was to provide model 
program developers with information regarding implementation of 
the critical components of a supported employment program. 

Data collection . All data were collected by University of 
Illinois staff during scheduled site visits. Two staf.^ members 
were responsible for all site visits and data collection. 
During these site visits, each agency's program coordinator and 
other designated program personnel provided staff members with 
written documentation related to each component of the degree of 
implementation. Data were collected over five weeks in May and 
June 1986, 

Outcome data collection . Descriptive outcome data (i,e,, IQ 
score, hourly wage, and number of job development hours) were 
provider^ by each agency on a monthly basis. Each model proga-am 
responded by mail to questions r agar ding individual demographic 
tata (e,g,, IQ score, adaptive behavior score, additional 
handicappini conditions), individual employment s atus (e,g,, 
length of employment, number of hours worked weekly, hourly 
wage), training data (e,g,, hours of direct training, advocacy, 
case coordination), an'l proj»Bct implementation data (e,g,, hours 
spent in job development, nuinber of individuals placed, program 
^ coses) for e' ch person they served, 
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Reliability. Tne two University of Illinois staff members 
who provided on-site technical assistance were trained to 
collect data on degree of implementation. Training consisted of 
making 10 site visits jointly in order co agree on the scoring 
procedures The two staff members then -iivided and visited the 
remaining 23 model programs. After each series of visits, the 
staff members compared scorings in order to clarify further any 
inconsistencies in scoring any items on the instrument. 

Reliability was collected on 6 of the 33 programs during the 
second round of site visits by ccndur^.ing two separate and 
independent site visits (this second round of data was used for 
analysis in this study) . Program coordinators were instructed 
to provide each staff member with identical information. Scores 
were then compared, and a percent agreement was calculated. 

Selected Outcome Variables 

1^. Model programs reported IQ scores for each indi-Hjual 
placed. A mean IQ score was calculated for eactx program. 

Hourly wage. The mean hourly wage earned for each program 
was calculated using all individuals' hourly wages. 

Hours spent in jo b development . Each program recorded the 
number of hours that were spent to develop employment sites in 
order to place the individuals. The mean number of hours per 
worker was calculated by dividing this number by the uumber of 
individuals placed by a rirticular program. 
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Data Analysis 

Correlational analyses were used to answer the two research 
questions concerning to construct validity. The integrity of 
each component and its relationship to the overall score was 
examined using a Pearson product -moment correlational analysis 
to create a correlational matrix comparing oach of the five 
component scores (e.g.. Job Survey and Analysis) with each of 
the other four component scores (e.g.. Job Fit, Job Acquisition 
and Maintenance, Job Match), and each component score with the 
total Degree-of -Implementation score for each program. 

In addition, a correlational analysis was performed to 
determine the extent to which each component score and the total 
score intercorrelated with the three outcome variables. 

Results and Discussion 

Reliability 

Reliability data were collected on six £ .parate occasions. 
Percent agreement was used as a measure of reliability. 
Reliability ranged from 7 5 to 96% with a mean score of 90%. The 
lowest score (.75) was attrib\ted to a program coordinator who 
had provided additional documentation to one rater. 

Validation 

Correlational analysis for each component score in relation 
to each of the other component scores yielded moderate 
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correlations (range - .49 - .75), all of which were significant 
at the .01 level and above (see Table 1). These moderate 
correlations indicate that the components measure the same 
general construct to some extent, at the same time retaining 
enough differences to measure some unique ^^.spect of that 
construct. This evidence supports the validity of the five 
components of the DOI for measuring a unique aspect of the model 
as well as collectively contributing to a composite score 
representative of the overall implementation of the program. 

The component scores correlated with the total score on the 
DOI. These correlations were significant at the .001 level 
These high correlations (range = .70 - .93) indicate that each 
component score is directly related to the total DOI score and 
contributes very significantly to its composicion. The best 
predictor of overall DOI score was job survey, followed by job 
acquisition and maintenance, job fit, and job match. The 
category conjunctive job services/interagency coordination was 
the poorest predictor of overall implementation, possibly 
because this activity is more important to fully operational 
programs. Most programs were not fully implemented because they 
had been operating for only a short time. 

Sum mary Statistics and Outcome Intercorrelat ions 

The summary statistics in Table 2 indicate that although DOI 
data were collected on 33 programs, outcome data were not 
a^'ailable from all programs. Means, standard deviations, and 



Table 1 

Correlational Analysis fo the Components of the Degree-of~ 
Implementation Instrument with Other Components and the 
Total Score and Summary Statistics (N = 33)' 



Job Hatch Job Acqu. Con. Job Ser./ Job Fit lotal X S.D. 

and Ham. Inter. Coord. Score (Range)" 



Job Survey O.i^ t'.'.75 ..^9 0.73 0.^3 11.39 t.77 



Job Hatch - ^).56 0.55 0.80 ^.03 8.36 

^0-8) 



Job Acqu. - - 0.i»9 0.65 3.E^ ^.r 

and Hain. 0-8) 



Con. Job Ser.' - - - 0.58 O.'w 1.9^ c.85 

Inter. Coo-.. '0-8) 



Job Fit ... - o,p3 3.^7 p,39 

tO-8) 



Total Score ----- ^3.69 1^.32 

'0-50) 



All values Significant at ,01, those Vtjlues qreate; than cr equal to .55 a'-e sig'^'/icant at .001. 
Total :os5ible --ange fcf eacH cetp&nent ard total score is 8c, 8, B, 8, 10, and 56, respectively. 
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ranges are reported for the three outcome variables used in this 
btudy. Note that all correlational analyses were performed on 
variables and scores aggregated at the program level. 

The intercorrelations iDetween the selected outcomes seem to 
indicate a direct relationship between IQ and hourly wage, an 
inverse relationship between IQ and hours of job development, 
and a significant direct relationship between the hourly wage 
and the hours spent in job development. Although neither of the 
first two correlations is significant, they appear to indicate 
that the hourly wage increases as the IQ of the individual goes 
up, and that individuals with lower IQs need more hours of job 
development. Both of these findings are in accord with 
expectations that individuals with higher IQs would obtain 
better-paying jobs, and identifying employment for individuals 
with lower IQs would require more intense job-development 
efforts. Investigation of both the effectiveness of 
job-development efforts as well as employment expectations for 
individuals with lower-functioning levels might suggest 
alternate explanations. 

Outcome Correlations 

Table 3 presents the correlations between the overall DOI 
score, its components, and reported outcomes. 

First variable: IQ . The first set of correlations, with IQ 
as a variable, demonstrated an inverse relationship to the 
overaU DOI score; that is, more elements of the proposed model 



Table 2 

Summary Statistics and Intercorrelationcil Analysis of 
Selected Outcomes 



N t S.D. Range Hourly Job 

Wage Developaent 

(Hrs) 



''^ \33 h".^0 to >.90 0.31- - .03^ 

^:'jriy Ka^e 3.17 1.25 1.60 to / 15 - \A8^ 

]•:!: Devel'jpcent EE c.33 2. "J; 0.00 to ' 5^ 
■Hrs/ 



• N=23 
N=2l 

' N=22; p .05 

Note. Ail -'a^ia^les and ^co-es aqQ^egated at the prcgrai ieveL 
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Table 3 

Correlational Analysis of the Degree of Implementation 
With Selected Outcomes 



Job Survey Job Hatch Job Acquis- Conj. Job Job Fit Total 

H I Analysis tion i Hain- Services/ DOI 

tenance Int. Coord. Score 

26 -'jM' -OM' -0.^3- -0.15 -0.h3* 

Hourly wage 2<» -':.02 -0.lt -0.21 -0.18 -'j.oi -O.ll 

Hours of job 22 0.<>6* 0,48* 0.25 0,21 u.23 0.^3* 
deveiopient 

♦ p ' .05 

N'^te. All vdrisbles and scores aggregated at the proqrai level. 
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were found to be in place as IQ scores of the clients 
decreased. Conversely, as IQ scores increased, fewer components 
of the model were found to be in place. Thus, it appeared that 
level of client functioning was inversely related to the 
intensity of services necessary to obtain employment. It may be 
that fewer services associated with the various components are 
necessary with higher functioning clients. 

This finding is supported by the significant correlation 
between IQ and the total JuCI score. Three other significant 
correlations in this set (job survey and analysis, job match, 
and job acquisition and maintenance) lend additional support to 
this finding. Once again, these components were inversely 
related to IQ. These findings indicate that the need for 
activities related to these components may be more necessary 
when placing parsons with lower IQs, These findings do not 
imply thai: the model is not applicable for less severely 
handicapped individuals; these data suggest that some model 
programs were not implemented as completely with mildly 
handicapped as with sever^^ly handicapped clients. 

Second variable: Hourly wag e. These correlations indicated 
an inverse relationship between the hourly wage and overall DOT 
scores. This finding suggests that higher hourly wages were 
earned when fewer components of the mc iel were implemented, 
which follows the previous line of thinking that fewer 
components of the model were implemented for higher functioning 
workers who could expect and earn a higher hourly wage, 
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Third variable: Hours of job development . Finally, 
significant positive correlations between the number of hours 
spent in job development, job survey and analysis, and job match 
scores suggest that more job surveying and matching activities 
occurred in programs that spent more hours in job development. 
This finding might simply be a function of the capability of 
these programs to perform more job-matching activities when 
there was a larger selection of job possibilities, and more time 
surveying the community increases the number of recorded hours 
of job development per individual placed in supported 
employment. The significant correlation of this variable with 
the total DOI score may have occurred because the job survey 
component is the largest (11 of the 28 activities). 
Nevertheless, this significant relationship indicates that as 
more hours were spent in job development, the total DOI score 
increased. These significant positive relationships seem to 
reflect the intensity with which some programs searched for jobs 
that potential workers might be able to perform. Those programs 
that spent more hours in job development implemented more of the 
model . 



General Discussion 



This study provides evidence that supports the validity of 
an instrument used to measure the degree to which model 
supported employment programs in Illinois are implemented. This 
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research suggests that the instrument's items measure unique 
components of the supported employment model and contribute to a 
composite score that reflects overall implementation. These 
relationships are evidence of construct validity of the 
instrument. 

The daca presented here also support several reasons for 
implementing the suggested employment model. These include: 
(a) the need for more intense efforts to serve a 
lower-functioning population of workers, (b) the relationship 
between more hours spent in job development which results in 
higher hourly wages as well as more opportunities to match an 
individual to the most appropriate employment option. 

The data also pose some interesting questions that warrant 
further investigation. For instance, the components of the 
model that combine to produce the most effective outcomes for a 
particular disabled population are not fully understood. An 
item analysis and further correlational analyses of various 
combinations of the components and parts of the components with 
various outcomes might lend some explanation. Also, employment 
outcomes for individuals with severe handicaps are just 
emerging. Statewide efforts such as those reported in this 
volume suggest that persons with severe handicaps are adapting 
to nonsheltered employment, along with their direct service 
providers and advocates. Continued data collection and analysis 
may afford a more complete picture of these employment options. 
Further study is needed to establish the relationship between 
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what services are delivered by a program and what is 
accoi^plished through those services. The correlation between 
process variables and outcome variables should be assessed 
through analysis of followrUp cases. This type of research 
could enable researchers to support empirically their contention 
that cheir models attained the outcomes they targeted, allow 
other researchers to investigate outcomes of service delivery 
models, and establish some standard to provide services and 
investigate outcomes in the context of model variations and 
model improvements . 
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Case Study Analysis 
of Three Supported Employm^int Model Programs: 
The Comr.unity, the Agency, and the Program 

Debbxe L, Winking 
and 

Lizanne DeStcfanc 



Community-based employraent ^^rograms have become increasirigly 
important in the overa 1 service delivery system of adult 
serviCiL aqencies. This Lupetus for change can be attributed to 
at least three factors in our society. 

First, a new type of adult clientele has emerged from 
public school special education programs. These students 
possess numero^^s functional skills fostered by a background rich 
in community-based training. These young adults and their 
parents are becoming increasingly dissatisfied with segregated 
vocational programs and demand their place as integrated 
independen\- citizens. Second, a service delivery system that 
has traditionally not promoted movement of clients through the 
system has in many cases produced long waiting lists for intake 
into sheltered workshops. Third, a small nuniber of 
c immunity-based vocational programs have evolved as a general 
response to the attitude espoused long ago by proponents of the 
principle of normalization. 
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The past 10 to 12 years have seen the divelopment of 
community-based employment programs that responded to these 
needs. These programs were designed to provide job- seeking 
assistance and time-limited training, exclusive of more 
intensive and long term service. The focus of these programs 
suited the needs of individuals with mild handicaps who were 
expected to maintain integrated employment if given initial 
training and occasional follow-up services. A group of 
individuals, usually those with training needs of greater 
intensity, were still deemed inappropriate for work in the 
community. 

Supported employment programs have recently emerged as a 
powerful employment option for individuals who have for the most 
part been excluded from community employment because of the 
severity of their disabilities or behavioral problems. 

According to the U.S. Department of Edujation (1985), the 
concept of supported employment may be defined as '*paid work in 
a variety of integrated settings, particularly regular work 
sites, especially designed for severely handicapped individuals 
irrespective of age or vocational potential." These programs 
provide ongoing training to persons with severe disabilities who 
are not expected to succeed in the workr^lace without continued 
support. It is because of this degree of permanence at the 
worksite that the sup ^^or ted employment program nas been 
established as an organization that is an integral part ot, and 
at the same time, an entity outside the physical environs of the 
Adult service agency. 
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Supported employment programs are unique corpared to other 
vocational service delivery options because of the population 
they serve and the delicate balance that they must maintain 
between the needs of che client and those of business and 
industry in order to provide long-term support. For these 
reasons, is important to those in rehabilitation and 
traditional job placement to analyze these pioneer programs. 

The purpose, then, of the case study was to examine in depth 
three programs involved in the Illinois supported employment 
initiative. The dynamics of individual programs were analyzed 
to determine specific factors that might contribute to 
programmatic success \n implementing supported employment and 
might serve as a.i aid to agencies interested in replicating 
supported employment. 



ERLC 



Method 

The use of a case study form-it lends itself to a more 
holistic analysis of the everyday factors and perceptions that 
might influence program development and that might pass 
undetected using traditional quantitative measurement 
^Doroaches. In these particular case studies we utilize^ ^-hree 
techniques of data collection — interview, agency employee 
survey, and structured observations. Each of tnese methods is 
discussed in detail. 

Structured interviews . Structured interviews were conducted 
with all key stakeholders directly or indirectly .avolved with 
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supported employment. In these particular case studies, 
targeted stakeholders included project coordinators, job 
trainers, job placement specialists, executive directors, 
residential management staff, residential direct-care staff, 
workshop staff, employers, co-workers, workers, and parents. 
The purpose of these interviews was to assess perception of the 
supported employment program as it affected each of the 
above-mentioned groups. 

This report is based on 61 interviews conducted across the 
three participating agencies. 

Agency employee survey . A survey was administered to 
employees of the agency who were not a part of the supported 
employment program including workshop staff, residential staff, 
and clerical personnel (see Figure 1). The purpose of this 
instrument was uo survey the knowledge and perceptions of 
supported employment among agency personnex not involved in 
support ed emp loymen t . 

Structured observations . Observations were conducted at 
actual employment sites. These observational periods, which 
ranged from 45 to 150 minutes in length, focused on the job 
trainer as representative of not only the program but also the 
entire agency to community employment sites. A minimum of ''5 to 
18 hours of structured observation were conducted at each 
program. These hours were divided among two to three community 
multiple placement sites. These observations allowed 
researchers to obte'n vital information pt^rtaining to program 
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AGENCY EMPLOYEE SURVEY 

agency/ employee code 

Agency Kmployee Survey 



Position in agency ^How long in current position? 

How long employed by agency? 



1) Rate your knowledge of your agency's Supported Employment Program 

No knowledge High Knowledge 

1 2 3 4 5 

2) In your opinion, which of the following best cescribes the disability category of 
individuals served in the supported employment program: 

M Id Moderate Severe 

1 2 3 4 5 

3) How long have you been aware of t]ie existence of your agency's Supported 
Employment Program? (rnonths; years) 

(Circle one) 

How much value do you feel the supported emplo^nnenr program has for individuals 
served as compr.red to the other vocational programs offered by your agency in terns 
of the following characteristics: 

4) Lower wages earned Higher wages earned 



1 



5 



5) Less individualization More Individualization 
to client/worker neads to client/ worker needs 

1 2 3 A 5 

6) Less corra.unity More community 
integration integration 



1 



3 



7) At 3sent, what vocational program offered by your agency do vou feel hc^ the 

most impact on ina viduals served? 

Why? 
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8) Do you see the supported program expanding in the next year to play a greater r(;le in 
the overall agency? 

yes, supporter' emplcyment will expand within my agency 

no, :>»u.pported employment will not expand within my agency 

9) Rate your knowledge of duties involved in the position of job trainer/coach in yoar 
agency's supported employment program. 

Low knowledge High knowledge 

1 2 3 4 5 



10) Please list what you consider to be the most important duties or tasks for which a 
job trainer/coach is responsible. 

1 ) 

2 ) 

3) 

4) 

How do you feel thp position of job trainer/coach compares to the position of floor 
supervisor or ^ay trainer for the following qualities? 

The position of job trainer has compared to a floor supervisor: 

11) less prestige no diff rence niore prestige 

1 2 3 4 5 

12) Less responsibility no difference More responsibility 

1 2 3 4 5 

Vj) wer salary no difference Higher salary 

1 2 3 4 5 

14) Would you ever cor^ider the position of job coach/ job trainer for yourseli? 

yes no 

Why or why not? 



wzrnr^ Thank You For Your Cooperat.on, 
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dynamics at the actual employment sites, as well ar to verify 
data collected during interviews. 

Criteria Upon Which Programs Were Chosen 

These case studies were conducted with three supported 
employment programs, including one urban, one rural, and one 
suburban location chosen according to the following four 
crl teria: 

1. programs t.hat had developed multiple placement sites 

or enclaves (two or more workers with the job 
trainer ) , 

2. programs that had placed the numbers of workers 
specified in their grants, 

3. programs that approximated the population targeted 
for service by the initiative (i.e., individuals 
v.ch severe disabilities), 

4. programs scoring in the upper quartile and within 5 
points of cne another on a degree-of -implementation 
measure. (The instrument used was developed by Mr. 
John S. Trach at the University of Illinois). 

Program Profiles 
Case study 1 . Case study 1 was conducted at a suburban 
program located about 30 miles south of Chicago. The agency 
include? a workshop, a residential facility, and a school 
program. This agency i^ad never been involved in community 
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emplc TTient placement befor^B beginning their supported employment 
grant in May 1985. The grant currently employs a program 
coordinator, a lead job coach, two full-time job coaches, and a 
clerical staff person. 

Tho initial supported employment sites were established in 
February 19^^. To d te, operational employment sites include 
two enclaves for food service and bedmaking at a nursing home, a 
clerical enclave in a large bank, and an individual placement as 
kitchen worker in another location of the same bank, with a 
total of nine workers placed at the sites mentioned Workers in 
multiple placements range in I.Q. from below 30 to 54. 

Case study 2 . Case study 2 was conducted in a rural town 
with a population of approximately 5,000, The agency includes a 
workshop and a residential facility. This agency had never been 
involved in community employment before the initiation of the 
supported employment grant in May 1985. 

The grant currently employs a program coordinator and two 
full-time and one part-time job coaches. 

Because of the lack of availability Oj: community employment 
sites suitable for multiple placements during the early stages 
of implementation, this program began with individual placements 
and has gradually moved to serving clients through 
multiple-placement sites. Although other individual placements 
were made, this program's first multiple-placement sites were 
established in September 1986. 

These multiple placement siter. include janitiorial e -rlaves 
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in a survey equipment warehouse, a county department building, 
and a laundry and janitorial site at a mid-sized nursing home in 
a neighboring town. A total of 16 workers were placed in these 
enclaves and individual placement sites. The IQ scores of 
workers at multiple-placement sites range from 18 to 50, with 
the exception of one worker whose score is 66. 

Case study 3 . The third case study was conducted in an 
urban setting, a city with a population of 200,000, at a 
comprehensive agency with a workshop and residential facility. 
Before receiving supported employment funds this agency had some 
experience in placing clients in community employment through a 
janitorial training program that provided several weeks of 
intensive skills training before placing the. in janitorial 
positions. 

The grant currently employs a program coordinator, three 
full-time and two part-time job trainers, and a clerical staff 
persor . 

This program's first sites were operational ±cxst June. 
Twenty workers have been placed at the seven multiple-placement 
sites operational to date, including food service at a large 
community college, fast-food establishments, laundry service, 
and two separate clerical enclaves in an insurance company. The 
IQ scores of these workers range from 28 to 55. 
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Levels of Analysis 

This paper will attempt to aggregate these three case 
studies to analyze 1 he role of the supported employment program 
at the individual, agency, and community levels • 

rhe analysis encompasses the current status of perceptions 
of supported employment today, 18 months after the beginning of 
the Illinois Supported Employment Inititative, as well as 
implications for the future. 



Analysis at the Program Level 

Without question, supported employment was viewed as a 
successful and powerful program option by job i^rainers, program 
coordinators, and others directly involved in the implementation 
of supported employment. 

The program ^ ^mponents overwhelmingly cited as most 
important to a successful supported employment program by 
coordinators and job trainers were teamwork and communication. 
In almost all instances staff members state that all roles are 
equally crucial in a supported employment program. 

One job trainer made the following comment about staff roles 

in her supported employment program: 

I can't say which job is most crucial to a 
successful supported employment program. We need 
someone back in the office providing the "glue" 
--dealing with agencies, state funders, getting 
funding so that the job trainers can be involved 
in direct training on-site daily. 

and 
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Our job titles are just th t; we are all equal in 
the weekly meetings. 

When asked to define communication, program personnel 
explained that this means effective communication at all levels, 
including across program roles (i.e., job trainer to job 
placement specialist to program coordinator), and between the 
program and other key stakeholders (i-e-, parents, worker, 
co-worker , and employer ) . 

Clear communication is evidenced in the degree of 
understanding staff members have for each other's roles in the 
delivery of this new employment option. Consistently 
throughout interviews job trainers could explain accurately the 
tasks involved in their program coordinator's job and why they 
were necessary. 

Likewise, coordinators were sympathetic to the demanding 
role of the job trainer, in these particular programs 
coordinators gave job trainers the necessary autonomy at the 
site while being careful to establish strong support systems to 
make job trainers feel less isolated and still a part of the 
agency. Examples of support systems include allowing job 
trainers sufficient time to return to the office for paperwork 
and program planning. Program coordinators also established 
weekly or biweekly meetings to allow job trainers to report on 
the status of che various employment sites they manage, as well 
as to update job trainers on impleinentation issues, agency 
policies, and other pertinent concerns. Thes.e meetings were a 
positive avenue for two-way communication between direct service 
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and administrative staff and weu considered essential due to 
the community-based nature of the programs. 

Day-to-day manifestions of this hi'^h level of teamwork and 
communication were evidenced in all three programs, where, for 
example, the coordinator has done actual training ok site to 
help out in peak times, to provide job trainers with release 
time, and to cover staff vacations. 

Finally, program coordinators and job traiiiers felt l^hat 
agency support was definitely top-down support. They 
emphasized the importance of an involved executive director as a 
factor in the success of their supported employment program. 

Exeoucive directors were perceived by program personnel as 
performing a number of vital support functions. These support 
functions include : 

1. Endorsing the program within the agency. In this 
function, the executive director plays an advocate role 
for the supported employment program within the agency 
itself. For example, the executive director may give a 
speech explaining supported employment goals at an 
agency-wide meeting. Staff of the three programs stucded 
felt that agency staff was more likely to support a 
program that their executive director actively promoted. 

2. Being a public relations person for the program because 
their positions as chief administrators and figureheads 
of their agency, executive .'rectors often speak to 
community organizations such as Rotary cIuds, business 
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advisory councils, and parent groups. These occasions 
provide excellent opportunities to acquaint these 
business and consumer groups to new program options such 
as supported employment- 
3. Being an advocate for alter-^ative funding within the 
agency and through outside sources. Because of their 
role in supervising the agency budget, executive 
directors usually have an awareness of other private 
funding sources, such as Goodwill Industries, which are 
already being tapped to supplement other programs in the 
agency, as well as access to other discretionary funds 
within the agency. 

Implications for the Future 

Program growth . Supported employment program are 
encouraged by the rapid progress their programs have made in 
what is essentially the first full year of operational community 
placement sites. Program personnel were optimistic about the 
future of supported employment. 

Program coordinators and job coaches alike projected that 
greater numbers of clients would be served through supported 
employment in the next two years. One vocational 
coordinator/program director anticipated that 25 ol their 50 
workshop clients would be placed in tie next two years. 

Increased independence . All staff members saw increased 
independence among those workers presently placed. Examples of 
independence included behaving appropriately in the absence of 
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the trainer^ self-control of inappropriate behaviors that 
previously interfered with iriependence in the community, and 
instances of increased use of public transportation and 
self -initiated contacts with co-workers. As evidence of a 
changing locus of control and increased independence, program 
staff described what they saw as "real desire" on the part of 
some workers to do things without trainer assistance. 

Consumer support. Greater parent and employer cooperation 
was envisioned for the future as both consumer groups came to 
see the successes in the community of other SEP workers. Staff 
felt that in their programs' successes were already becoming 
contagious. New employers were initiating contacts with the 
agency to learn more about the supported employment program 
because they had heard of its success from other employers, 
Similarily, some parents who had seen former workshop clients in 
community jobs were becoming increasingly interested in securing 
a position in the program for their sons or daughters. 

Increased job options . Job coaches repeated the hope of 
securing more "nontraditional" enclaves in the future. In the 
less industrial setting of the rural community, the target was 
stock positions in shoe storer^ and dress shops, whereas in 
suburban and urban settings, clerical positions in banks and 
insurance companies were desired, 

Imprcved quality of life . Staff saw supported employment 
future outcomes as not rest^'icted to the vocational growth of 
the workers, but as having implications for all aspects of their 
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lives • As individuals become more competent and more 
independent, staff anticipated such outcomes as clients moving 
into less restrictive living arrangements (i.e., movement to 
group homes from Intermediate Care Facilities ICF/DD ) as well 
as independence in accessing public transportation and 
recreation facilities . 

Potential deterents . Staff members were not without 
questions when it came to the future of supported employment • 
Some of the factors that were considered as potential deterrents 
to the realization of these outcomes included: 

1. placement failures in the community, causing 
renewed parental and entployer resistance, 

2. lack of adequate funding, causing programs to 
keep willing employers waiting, 

3. need for more staff, 

4. the ability of supported employment to attract 
and hold quality employees at the direct 
service or job trainer level because of 
inadequate salary schedules, 

5. lack of formalized staff training to prepare 
trainers to work with the target population, 

6. a declining economy, 

1* lack of adequate and connecting 

transportation in suburban and rural programs. 

Analysis of Agency Suppor t 

Perceptions of success of the supported employment program 

did not end with direct staff of the program alone. Although 

these supported employment programs may be considered to be 

still in their infancy, case study survey and interview results 

indicated that the impact of the supported employment prograra 

was surprisingly strong, even at the agency level. 

P erceptions of executive directors . Executive directors 

^ were in agreement with job trainers and program coordinators 

ERJC QQ 



Case Study Analysis 

87 

that commitment and teamwork of piogram staff were the most 
important factors in the establishment of supported employment 
as an innovative and different service option for their 
agencies . 

Directors also cited a "supported employment philosophy" or 
commonality of purpose within the staff of the program, and an 
inclination and willingness to work in a nontraditlonal 
^environment as the most important factors in a successful 
supported emp-._oyment program. They felt that supported 
employment staff could not excite the entire agency to the idea 
of supported employment unless they had a firm hold on just what 
their mission was. Thio philosophy is necessary, one executive 
director said, " to sell the idea of supported employment to all 
concerned partieo." 

Executive directors see supported employment as a good 

public relations program. One executive director related 

the following thoughts on the supported employment program's 

impact on the community: 

Supported employment has almost singlehandedly 
made us visible to the comnunity . The community 
sees effective work being accomplished. I am 
excited because I can now go to the community from 
a position of strength as opposed to charity. 

Although directors see supported employment as a new and 
exciting option, they commented that it has been difficult at 
times. In the beginning, one executive director saw supported 
employment as risky, because it was a program that did not fit 
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the rules that adult service agencies had traditionally 
followed. Alter being involved with the program for more than 
a year, he now feels that his agency's involvement in supported 
employment is vitally important from a systems change 
perspective. He summed up his feelings about the risks 
involved in initiating a new service option within an existing 
system as follows: 

If you wait for issues to be resolved you will 
never go forward. Only by sticking your neck out 
initially and challenging the existing systems do 
you see positive change in policies and 
disincentives. Now that we have been in supported 
employment and taken some chances are we able to 
go to the legislators and show them just where the 
policies may need to be revised. They [the 
legislators] need a tangible issue to address. 

These executive directors see supported employment as a 
chance to enhance the client's quality of life, as an 
excellent public relations tool having positive 
repercussions for all programs within the agency, and as a 
way of moving individuals through the service system to 
reduce in-house program waiting lists. 

However, i-hls group does not see supported employment 
as phasing out all other programs in the agency: 

SEP is not "the thing" for us; however, I do 
see it as a tremendously important component in an 
array of ser' . ces. 

Program personnel (job coaches, job placement specialists, 
and program coordinators) have emphasized the importance of a 
supportive executive director as an advocate for their program. 
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If this the case, at least in these agencies the director may 
be seen as having a special in^'estment in positive supported 
employment outcomes. 

Put what about other groups withia the agency, having 
puipos3S separate from, and traditionally thought to be counter 
to, the aims of community-based employment? How do directors of 
day training programs, floor supervisors, agency-run 
intermediate care facility operators, and direct residential 
staff feel about supported employment? The next section 
explores the reactions of these groups to the supported 
employment programs in their agencies. 

Perceptions of agency personnel . Workshop and residential 
management staff (i.e., directors of Day Training 1 and Day 
Training 2 programs, agency social workers, directors of 
residential facility) also cited "110% commitment and teamwork" 
of program staff as responsible for the current success of 
supported employment in their agencies. 

Specifically, frequency of staffings, coordination of agency 
individudl case counselors with supported employment staff, and 
a general willingness on the part of job trainers and program 
coordinators to do "whatever is necessary to make the program 
work," were cited as evidence of teamwork. 

One residential program manager commented that, as a result 
of supported employment, her residents now had more choices: 
"Before supported employmant, as a client, if you were not 
interested in janitorial v;ork there just was not much out there 
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for you." 

Although this support had to be earned through allowing 
agency persor.nel to see actual successes of community 
placements, there is evidence that agency employees support this 
new community employn^ent optior 

Future Role of Supported Employment in the Agency 
As for the role that supported employment would play in the 
entire agency in the future, all groups from floor supervisor to 
residental care r>taff to executive directors saw the role of 
supported employment expanding in the next two years. 

A significant number of these persons saw supported 
employment as the focus of programming in the future. However, 
these were not visions of supported employment as a replacement 
for all other programming options, but rather a view of 
supported employment as vital part of all vocational services. 

One director of DT2 had this to say about the future 
relationship of supported employment and her program: 

Although cooperation between the programs has 
been great up to this point, I would like to see 
greater integration between the DT2 program and 
SEP. Our role (the workshop's) for SEP clients 
would be as an adult education center, just as an 
adult learning center is for anyone who is 
employed and seeks further education in the 
evenings . 

This workshop supervisor does not envision her program in 
jeopardy, but rather providing a needed service in the personal 
and community development of supported employment workers. 
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(Similar comments were also made by the director of an 
intermediate care facility.) Living skills such as budgeting and 
money management, which are more appropriately practiced in 
settings other than work, would be supplemented by skills 
classes offered by the workshop using a continuing-education 
format • 

All agency personnel interviewed indicated that in the 
future-, greater numbers of clients will be served through 
supported employment. They outlined a situation in which all 
other programs, including affiliated school and workshop 
programs, would gradually change their focus to one of 
preparation for community employment. As more community 
placement sites are established, supported employment is likely 
to become a viable option for an increasing number of clients. 
The ranks of day training programs will change as lower 
functioning individuals from Day Training 1 (DTI) are funneled 
into Day Training 2 (DT2) as slots are opened by supported 
employment candidates. One agency executive director termed 
supported employment as the long awaited answer to the ''log jam" 
of adult service agencir:s. 

Overall Agency Involvement 
in the Supported Employment Process 

Why do these agency groups seem to be so invested in the 
concept of supported employment? Interview and survey as well 
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as observational results seemed to indicate a sense of 
involvement in the supported employment program by other agency 
staff. 

One might expect feelings of resentment on the part of 
direct-care staff in the workshop thcc supported employment was 
taking all the "good workers," or, similarly, in agency 
residential facilities, that supported employment created a lot 
of headaches, extra work, and schedule changes for them just to 
get clients ready in the mornings for their community jobs. 

The consensus of residential and management staff was that 
this was not the case. Much of this positive attitude seems to 
be due to the groundwork laid by supported employment program 
coordinators • 

Workshop and residential program managers cited the fact 
that program coordinators were careful to provide inservice 
orientation to agency personnel to the concept and philosophy of 
supported employment. They allowed agency personnel to share in 
the ownership of the program and in client success by making 
staff a part of the process used to targec potential workers for 
supported employment. Supported employment program staff kept 
other agency personnel abreast of client progress in the 
program, either on a formal or informal basis. In this way, if 
a floor supervisor could not claim direct responsibility for a 
new supported employment candidate's success at a community job 
site, at least he or she could feel a part of the process used 
to target that individual for services. These perceptions of 
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involvement are evidenced in the following quotation from an 
administrator : 

All administrators of all units were involved 
from the very beginning, allowed to give input. 
We are invited to staffings. We don't see it as a 
separate program but as part of the team. 

Another positive strategy that was reported to enhance 
agency support was allowing supported employment workers to 
visit the agency after being successfully placed on a community 
job, A day- training assistant director commented on how 
important it was to her when SEP workers came back to the 
workshop to visit, because then she was able to see the progress 
made through her initial efforts in preparing individuals for 
supported employment. 

Strategies used by program coordinators to involve agency 
personnel varied among the programs studied. One program 
offered a monetary incentive to anyone in the agency who 
provided a job lead that resulted in an employment site. Other 
programs provided agencywide inservices. Er^.ch of these 
activities was olanned to achieve a common goal, that is, 
fostering a sense of ownership for the supported employment 
program vithin the agency at large; this implies a client-needs- 
based approach to service delivery which is often espoused as an 
agency philosophy. However, because supported employment is a 
new and different program option and is not based within the 
walls of the agency, extra preparation may be necessary to gain 
support and to allow agency staff to feel the same degree of 
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ownership that they may feel for other programs within the 
agency . 

Results of the Agency Employee Survey parallel the comments 
of management staif that in fact direct service personnel in the 
agency did support the Supported Employment Program. Even though 
the program i.s relatively new (operational sites just beginning 
within the last year), in all three case studies agency 
personnel cited supported employment 57%, 78%, and 50% of the 
time (with a mean of 63%) as the vocational program having the 
most impact on individuals served in the entire agency (Table 
1). 

These positive attitudes are further highlighted by the fact 
that all those surveyed stated thac they anticipated that in the 
future, supported employment would play a greater role in the 
overall agency. One might conclude from these results that if 
agency staff did not feel that SEP was having the greatest 
impact at the present time, they all saw it as having a grou-ing 
role in the future. 

Respondents felt that supported employment offered greater 
individualization, more integration, and higher wages than other 
vocational programs offered by the agency (Table 2). 

The answers of employees to the survey questions reflect 
some degree of understanding of the philosophy and goals of 
their agency's supported employment program and underscore the 
importancp of increasing understanding of supported employment 
within the entire agency. 
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Perceptions of Agency Employees 
About the Supported Employment Program 







AGENCY 




MEAN 




1 


2 


3 




Which vocational 
program offered by 
your agency has the 
most impact on 
individuals served 


J, 

o 


% 


% 


Q. 

o 


SEP 


57 


78 


50 


63 


Workshop 


43 


22 


50 


37 


Will supported employ- 
ment play a greater 
role xn your agency in 
the future? 










Yes 


88 


100 


100 


95 


No 


0 


0 


0 


0 


No Opinion 


1 









N = 33 
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Mean responses of Agency Employees Concerning 
^e Valua of Supported Employment 
oir pared to Other Agency Programs 



Question: How much value do you feel supported en.ployment has to 
individuals served compared to other vocational programs offered by 
your agency? Please rate your answer on a scale of 1 (low) to 5 
(high) . 



Wages earned 



1 
1.8 



^GENCY 
2 

4.3 



4.3 



TOTAL 



4.5 



Individual- 
ization to 
client needs 



4.4 



4.4 



4.8 



4.5 



Community 
integration 



4.9 



4.8 



4.8 



4.8 



N = 33 
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Analysis at the Community Level 



Of course, since community integration is integral to to the 
concept of supported employment, we cannot ignore community 
perceptions of these programs. 

This concept of the term community r^^y be c^efined on three 
levels: a) employers and co-workers, b) parents as an invested 
extension of the program, and c) the communty resident 
viewpoint. 

Community support . Most of those staff members interviewed 
felt that it was too early to get a clear indic<ution of support 
at the community resident level. However, all program staff did 
say that they had never experienced an outward sign of d. jmay or 
shock on the part of the community to the workers that they were 
trains ng. 

This may be due partly to the public relatio' work and 
exposure given to the program through the efforts of supported 
employment personnel. Public relations techniques used to 
heighten public awareness of supported employment for persons 
with severe disabilities include contacting the local chamber of 
commerce, press releases, TV and radio spots featuring supported 
employment, and coverage of employer appreciation banquets. 

These marketing strategies have dual benefit for programs. 
First, they heighten public awarness, and second, they provide 
recognition and publicity for employers who are partcipating in 
the supported employment initiative. Fcr example, employers 
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noted that after a television special, a radio spot, or a news 
article was released, many customers would comment about i^ow 
great the special was , or what a worthy program they must be 
sponsoring. 

Employer Support , The interaction between the employer and 
co-worker in the supported employment process is essential in 
any discussion of community perceptions of such programs. 

All employers served by these employment programs were in 
favor of expanding supported employment. Some were actively 
trying to recruit more supported employment individuals for 
already-established enclaves, while others felt that although 
there were no more slots available in their employ, they would 
recommend the supported employment arrangement to other 
businesses and companies. 

In almost all cases, favorable attitudes toward expansion 
were based on a single criterion, success. One employer said 
that the positive accomplishments of an earlier supported 
employment placement had allowed expansion into her unit of the 
bank. "As long as we continue to have success, why not?" she 
said. 

What did these employers feel was essential to successful 
supported employment in their businesses? Again the answer was 
the support and commitment of the entire supported employment 
staff. Employers were particularly reassured that through the 
collective efforts of the worker, the job trainer, and the 
program coordinator, the job would get done. Many commented that 
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they had seen a program coordinator come in, roll up his or her 
sleeves, and assist with training if the regular job trainer was 
absent* According to employers, they felt that in supported 
employment they had finally found a social service program in 
which staff as well as the program itself were truly geared to 
their production needs. 

Almost all the employers interviewed admitted that in the 
beginning they had had some reservations about hiring persons 
with severe dic^abilities • 

One employer felt that when the program was explained to her 
by the job developer, i.t was too good to be true, "Support at 
the site at all times? None of her regular supervisors' time 
would be spent to train this new group?" It was hard to 
believe. But after months :n the program she saw that the 
initial promises of continued support and supervision were 
delivered Her reservations about workers with disabilities 
were disspelled as she actually saw the job getting done. 

Comments reflected positive attitudes toward not only the 

program in general, but also the workers themselves. 

One direct supervisor commented of her supported employment 

workers who had been on the job for nearly a ' ^r : 

Now 1 sometimes forget that they ar^B 
handicapped and I begin spouting off commands. 
This group is part of the kitchen team. At first I 
thought we'd hit a plateau with them, that there 
would be only so rrach they could handle. However, 
I find that I am able to continuously increase 
their duties and responsibilities. I treat them 
all the same. They get the same privleges and 
reprimands as everyone else. 

I'i2 
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And a co-worker voiced the initial feelings of his peers toward 

workers with severe disabilities: 

A lot of people have a hard time getting over 
the fact that people are different. However, when 
we learned that they [the SEP workers] would be 
working on our floor, we had to respect them for 
the job they do, just as we do all the aides and 
nurses. They are legitimate workers here, and they 
make everyone's job easier. 

Parent support . Parents too were encouraged by the success 
oZ their sons and daughters. Although many could not explain 
the specific activities involved in the training conducted with 
their adult sons and daughters, they were particularly 
reassured by the frequent contacts and support provided by 
program personnel. All three programs had weekly contact with 
the parents or the residential facility or both. To obtain an 
additional measure of parental/residental satisfaction, one 
program required parents to complete an evaluation of the degree 
to which the supported employment program was meeting their 
needs . 

Finally, all parents interviewed expressed a sense of 

satisfaction that their sons or daughters were included in a 

unique program that offered a real job in the community. 

They [the program staff] told us that they 
wanted her to go out in to the community; at first 
I did not think she would be able to do it. They 
promised that there would be someone there all the 
time. So I trusted the program staff, and they 
were right. She is happier now than she has ever 
been, and when she gets home from work, she always 
has something new to talk about. 

Since Joe has been in the program we have 
watched the progress. It is the greatest thing 
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that ever happened to him. Now Joe has goals when 
he wakes up in the mornings , He tells us he wants 
to work faster, and better, than the day before 
and be more independent of his trainer every day. 

Future Implications 

What conclusions may be derived from this case study 
analysis of three community employment programs? First of all, 
these results begin to demonstrate the level of :;ommitment and 
teamwork necessary to launch a new program option like supported 
employment successfully. 

Communication and public-relcitions work are necessary within 
the agency and with employers, parents, and the community at 
large. Since by the very nature of supported employment the 
program becomes highly visible to the public, the program 
coordinator and especially the job trainer come to represent in 
the eyes of the community not only the program but the entire 
adult service agency. 

As chief communicators to key stakeholders in the supported 
employm.ent process, job trainers and program coordinators have 
some unique responsibilities as well as advantages. They must 
respond continually tc the changing needs and production demands 
of the business community, which requires a working knowledge of 
business terminology and philosophy. However, they must balance 
the employci's needs with the needs of their number one 
constituents, the workers with developmental disabilities and 
their parents. Overwhelmingly evident was the importance of 
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making as many groups as possible in the agency aware and 
invested in the supported employment program. This duty of the 
program staff of laying the groundwork within the agency and of 
making supported employment an integral part ol all services 
cannot be ignored. 

The philosophy of a client-needs-based atmosphere that 
stresses the maximum growth potential of the individual, already 
espoused by many adult service agencies, must be extended to new 
coiranunity-based service options, such as supported employment. 
To foster ownership of the supported employment program, agency 
personnel must be made aware of the goals of the program and 
must be involved in the process of supported employment. This 
involvement may be of varying degrees, including general agency 
awareness programs, inclusion of other agency groups in 
supported employment program staffings, soliciting input from 
agency staff in targeting worker referrals, and possibly 
allowing agency staff a share in job development activities. 

Finally, this study underscores the need to recognize 
executive directors as essential to the continued success of 
supported employment programs. The support of the executive 
director is nec-ssary to lay the overall structure for supported 
employment, to provide adequate public relations for the 
program, to secure financial support, and to run interference 
against any counter forces inside or outside the agency. 
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ISEP 

Funded Projects 



Date/Time 

Staff Facility and Address 



Contact Person 



6/16 Aid to Retarded Citizens Inc, 

9:00 2719 S. 11th St. 

DW Springfield, IL 62703 



6/12 Ctr. for Disabled Student Serv. 
y:00 Chicago City-Wide College 
JST 226 W. Jackson, 6th Floor 

Chicago, IL 60606 



6/26 The Center for Rehabilitation 
9:00 and Training of the Disabled 

JST 6610 N. Clark St. 

Chicago, IL 60626 



*6/3 Chicago Assoc. for Retarded 
9:00 Citizens 

OW/JT 8562 S. Vincennes 
Chicago. IL 60620 

6/15 Comprehensive Services 

9:00 Box 428 

JST Mt. Vernon, IL 62864 



6/12 Developmental Services Ctr. 
9:00 1304 W. Bradley Avenue 
JT Champaign, IL 61821 



6/22 Effinghaiu Association for 
9:00 Retarded Citizens 

DW 618 W. Main St. 

Teutopolis. IL 62467 

6/9 El Valor Corporation 

9:00 1850 W. 21st St. 

JT Chicago, IL 60608 



6/19 Employer Resource Service/Arrise 
9:00 9790 Allen Street 
OW Rosemont, IL 60018 



Rcy'iOti & 

Agency 



3 

DMH/DD 
(411) 



5B 
DMH/DD 
(370) 



5A 

DMH/DD 
(403) 



Mark Schneider 
Patrick Wear, II 
Executive Director 
(217-789-2560) 

Dan Woodyatt 
Sally Vernon 
Director 
(312-641-2595) 

Carol Woodworth 
(312-929-8200) 
Cathy Lorber, Ph.D. 
Stuart G. Ferst 
Executive Dikector 
(312-973-7900) 



Robert Lewis 58 

Carolyn B. Thompson DMH/DD 
Dir. of Placement Services (401) 
(312-651-3720) 

Sharon SmUh 4 

John Metcalf DMH/DD 

Rehab. Director (231) 
(618-242-7300) 

Carole Powers 3 

Rick Krandel DMH/DD 

Dale Morrisey (422) 
Chief Executive Officer 
(217-356-9176) 

Michael Poe 4 

Michael W. Fortner DMH/DD 

Executive Director (475) 
(217-857-3186) 

Nina Marti no 58 

Gloria Morales Curtin DMH/DD 

Dir. of Adult Services (539) 
(312-666-4511) 

Rosalie Mattern 2 

James Johnson DMH/DD 

Executive Director (363) 
(312-771-2945) 
(312-671-5877) 



ERIC 



117 
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DatVTime 

Staff Facility and Address 



Contact Person 



Region & 
Ager >.y 



6/16 Franklin-Williamson Workshop 

9:00 902 W. Main St. 

JST West Frankfort, IL 62896 



6 '15 Happiday Centers, Inc. 

9.00 1005 W. End Ave. 

JT Chicago Heights, IL 60411 



6/22 Iroquois ARC 

9:00 Box 324 

JT Watseka, IL 60970 



6/16 Job Resources for the Disabled 
9:00 3140 N. Cambridge 
JT Chicago, IL 60657 



*6/23 Lake County Society for 
9:00 Human Development 

DW 3441 Sheridan Road 
Zion, IL 60099 

*6/2 The Lambs, Inc. 

9.00 P.O. Box 520 

JST/JT Libertyville, IL 60048 



6/30 McDonough Co. Rehab. Ctr. 
9:00 900 S. Deer Road 
JST Macomb, IL 61422 



6/30 North Shore Association 
9:00 for the Retarded 

JT 7855 K Gross Point Road 
Skokie, a 60077 

6/18 Occupational Development Ctr. 

9:00 400 N. East St. 

JST Bloomington, IL 61701 



Jeff Horton i 

Gail Kear DORS 

Executive Director (234) 
(618-983-5421) 
(618-937-6483) 

Diane Alexander 6 

Jim Kompik DMH/DD 

Patrick O'Brien (570) 
Executive Director 
(312-755-8030) 

Roberta loder 3 

Louellen Strong DMH/DD 

Executive Director (140) 
(815-432-5288) 
(815-432-6191) SEP Office 

Andy Tayaka 5 

Ms. Michael Rooney DORS 

Executive Director (337) 
(312-327-4412) 

Linda Milz 2 

Randy R. Ross DMH/DD 

Executive Director (419) 
(312-872-1700) 

Julie Metzger 2 

Gerald Y. Friedman DMH/DD 

Executive Director (391) 
(312-362-4636 or 361-3320) 

Mary Fran l 

Jim Starnes DMH/DD 

President (364) 
(309-837-4876) 

Pat Baer 2 

Gerald Gully DMH/DD 

Executive Director (422) 
(312-869-5515) 

Paula Knutson 3 

Lyn Hyrska DMH/DD 

Tomm Foss (451) 
Executive Director 
(309-8^8-7324) 
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Date/ Time 
Staff 


Facility and Address 


Contact Person 


Region 
Agency 


6/9 

9:00 

DW 


Open Door Rehab. Ctr. 
208 Beaver Street 
Yorkville, IL 60560 


Steve Strieker 
Marilyn Barman 
Executive Director 


2 

DMH/DD 

(671) 


6/8 

9:00 

JST 


Opportunity House, Inc. 
202 Lucas St. 
P.O. Box 301 
Sycamore, IL 60178 


Peter Bauman 
John R. Kroos 
Executive Director 
(815-895-5108) 


1 

DMH/DD 
(344) 


6/10 
9:00 
JST 


Orchard Village 
7670 Marmora 
Skokie, IL 60077 


Jack McAllister 
Vocational Director 
John Winke 
Executive Director 
(312-967-1800) 


2 

DMH/DD 
(576) 


6/18 
9:00 
JT 


Park Lawn 

5340 W. 111th St. 

Oak Lawn, IL 60453 


Brother Frank Portada 
Coord, of Voc. Services 
Jim Weiss 

Executive Director 
(312-424-8616) 


6 

DMH/DD 
(431) 


6/8 

10:00 

JT 


Ray Graham Association 
420 W. Madison St. 
Elmhurst, IL 60126 


Julie Seta 
James DeOre 
Executive Director 
(312-543-2440) 


6 

DMH/DD 
(407) 


6/10 

10:00 

DW 


Seguin Services Inc. 
3145 S. 55th Avenue 
Cicero, IL 60650 


Bob Brocken 
Rick Miller 
Executive Director 
(312-863-3803) 


2 

DMH/DD 
(420) 


6/11 
9:00 
JST 


Special Education Parents 

Alliance 
305 22nd St., Suite K-164 
Glen Ellyn, IL 60137 


Steve Tenpas 
Marjorie Lee 
President 
(312-790-3060) 


5 

DORS 


*6/l 
9:00 
DW 


Spectrum Vocational Serv. 

2302 Wisconsin 

Downers Grove, IL 60515 


Beth Anderson 
Peggy White 
Associate Director 
(312-852-7520) 
(312-355-6533) 


6 

DMH/DD 
(459) 


6/17 
9:00 
DW/JST 


Victor C. Neumann Assoc. 
2354 N. Milwaukee 
Chicago. IL 60647 


Susan Berns Baron 

Ilene Rosenberg 

Dir. of Vocational Serv. 

Carl H. LaMell 

Executive Director 

(312-235-6004) 


5A 

DMH/DD 
(135) 
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Date/Time 

Staff Facility and Address 



Contact Person 



6/29 Warren Achievement Ctr. 
9:00 1314 S. Main St. 
JST Monmouth, IL 61462 



6/23 Cornerstone Services Inc./ 
8-00 Will County Sheltered 
JT Workshop 

2401 W. Jefferson 

Joliet, IL 60435 



Mike Streight 
Jo McVey 
President 
(309-734-8331) 

Cindy Lapicki 
Don Hespell 
James Hogan 
Executive Director 
(815-744-7204) 



Region & 
Agency 



1 

DMH/00 
(428) 



6 

OMH/OD 
(487) 
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